Apr 11 20:28:54 user devstack@n-api.service[61906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 20:28:54 user devstack@n-api.service[61906]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 20:28:54 2023] *** Apr 11 20:28:54 user devstack@n-api.service[61906]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 20:28:54 user devstack@n-api.service[61906]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 20:28:54 user devstack@n-api.service[61906]: nodename: user Apr 11 20:28:54 user devstack@n-api.service[61906]: machine: x86_64 Apr 11 20:28:54 user devstack@n-api.service[61906]: clock source: unix Apr 11 20:28:54 user devstack@n-api.service[61906]: pcre jit disabled Apr 11 20:28:54 user devstack@n-api.service[61906]: detected number of CPU cores: 12 Apr 11 20:28:54 user devstack@n-api.service[61906]: current working directory: / Apr 11 20:28:54 user devstack@n-api.service[61906]: detected binary path: /usr/bin/uwsgi-core Apr 11 20:28:54 user devstack@n-api.service[61906]: your processes number limit is 63638 Apr 11 20:28:54 user devstack@n-api.service[61906]: your memory page size is 4096 bytes Apr 11 20:28:54 user devstack@n-api.service[61906]: detected max file descriptor number: 2048 Apr 11 20:28:54 user devstack@n-api.service[61906]: lock engine: pthread robust mutexes Apr 11 20:28:54 user devstack@n-api.service[61906]: thunder lock: enabled Apr 11 20:28:54 user devstack@n-api.service[61906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 20:28:54 user devstack@n-api.service[61906]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 20:28:54 user devstack@n-api.service[61906]: Python main interpreter initialized at 0x559d93083990 Apr 11 20:28:54 user devstack@n-api.service[61906]: python threads support enabled Apr 11 20:28:54 user devstack@n-api.service[61906]: your server socket listen backlog is limited to 100 connections Apr 11 20:28:54 user devstack@n-api.service[61906]: your mercy for graceful operations on workers is 90 seconds Apr 11 20:28:54 user devstack@n-api.service[61906]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 20:28:54 user devstack@n-api.service[61906]: *** Operational MODE: preforking *** Apr 11 20:28:54 user devstack@n-api.service[61906]: *** uWSGI is running in multiple interpreter mode *** Apr 11 20:28:54 user devstack@n-api.service[61906]: spawned uWSGI master process (pid: 61906) Apr 11 20:28:54 user devstack@n-api.service[61906]: spawned uWSGI worker 1 (pid: 61907, cores: 1) Apr 11 20:28:54 user devstack@n-api.service[61906]: spawned uWSGI worker 2 (pid: 61908, cores: 1) Apr 11 20:28:54 user devstack@n-api.service[61906]: spawned uWSGI worker 3 (pid: 61909, cores: 1) Apr 11 20:28:54 user devstack@n-api.service[61906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 20:28:55 user devstack@n-api.service[61909]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 20:28:55 user devstack@n-api.service[61908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 20:28:55 user devstack@n-api.service[61907]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 20:28:59 user devstack@n-api.service[61908]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 20:28:59 user devstack@n-api.service[61908]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 20:28:59 user devstack@n-api.service[61908]: and ``live_migration_inbound_addr`` respectively. Apr 11 20:28:59 user devstack@n-api.service[61908]: ). Its value may be silently ignored in the future. Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 20:28:59 user devstack@n-api.service[61907]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 20:28:59 user devstack@n-api.service[61907]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 20:28:59 user devstack@n-api.service[61907]: and ``live_migration_inbound_addr`` respectively. Apr 11 20:28:59 user devstack@n-api.service[61907]: ). Its value may be silently ignored in the future. Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 20:28:59 user devstack@n-api.service[61909]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 20:28:59 user devstack@n-api.service[61909]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 20:28:59 user devstack@n-api.service[61909]: and ``live_migration_inbound_addr`` respectively. Apr 11 20:28:59 user devstack@n-api.service[61909]: ). Its value may be silently ignored in the future. Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61908) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61907) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61909) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 20:28:59 user devstack@n-api.service[61908]: INFO dbcounter [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Registered counter for database nova_api Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_db.sqlalchemy.engines [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61908) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writer thread running {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61907]: INFO dbcounter [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Registered counter for database nova_api Apr 11 20:28:59 user devstack@n-api.service[61909]: INFO dbcounter [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Registered counter for database nova_api Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_db.sqlalchemy.engines [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61907) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writer thread running {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_db.sqlalchemy.engines [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61909) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writer thread running {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG nova.context [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e02bfc2-5dac-4137-870a-5f9b73964451(cell1) {{(pid=61908) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:28:59 user devstack@n-api.service[61908]: INFO dbcounter [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Registered counter for database nova_cell0 Apr 11 20:28:59 user devstack@n-api.service[61908]: INFO dbcounter [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Registered counter for database nova_cell1 Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_db.sqlalchemy.engines [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61908) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_db.sqlalchemy.engines [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61908) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writer thread running {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG nova.context [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e02bfc2-5dac-4137-870a-5f9b73964451(cell1) {{(pid=61907) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writer thread running {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG nova.context [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e02bfc2-5dac-4137-870a-5f9b73964451(cell1) {{(pid=61909) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 20:28:59 user devstack@n-api.service[61907]: INFO dbcounter [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Registered counter for database nova_cell0 Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:28:59 user devstack@n-api.service[61907]: INFO dbcounter [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Registered counter for database nova_cell1 Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:28:59 user devstack@n-api.service[61909]: INFO dbcounter [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Registered counter for database nova_cell0 Apr 11 20:28:59 user devstack@n-api.service[61909]: INFO dbcounter [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Registered counter for database nova_cell1 Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_db.sqlalchemy.engines [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61909) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writer thread running {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_db.sqlalchemy.engines [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61909) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_db.sqlalchemy.engines [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61907) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_db.sqlalchemy.engines [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61907) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writer thread running {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writer thread running {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61908]: INFO dbcounter [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Registered counter for database nova_cell0 Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG oslo_db.sqlalchemy.engines [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61908) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writer thread running {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writer thread running {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61909]: INFO dbcounter [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Registered counter for database nova_cell0 Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG oslo_db.sqlalchemy.engines [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61909) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writer thread running {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61907]: INFO dbcounter [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Registered counter for database nova_cell0 Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG oslo_db.sqlalchemy.engines [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61907) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 20:28:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writer thread running {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 20:28:59 user devstack@n-api.service[61907]: WARNING keystonemiddleware.auth_token [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 20:28:59 user devstack@n-api.service[61907]: WARNING keystonemiddleware.auth_token [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 20:28:59 user devstack@n-api.service[61908]: WARNING keystonemiddleware.auth_token [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 20:28:59 user devstack@n-api.service[61908]: WARNING keystonemiddleware.auth_token [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 20:28:59 user devstack@n-api.service[61909]: WARNING keystonemiddleware.auth_token [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 20:28:59 user devstack@n-api.service[61909]: WARNING keystonemiddleware.auth_token [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 20:29:00 user devstack@n-api.service[61909]: WARNING keystonemiddleware.auth_token [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 20:29:00 user devstack@n-api.service[61909]: WARNING keystonemiddleware.auth_token [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 20:29:00 user devstack@n-api.service[61909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d93083990 pid: 61909 (default app) Apr 11 20:29:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:29:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001480 Apr 11 20:29:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 20:29:00 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:29:00 user devstack@n-api.service[61908]: WARNING keystonemiddleware.auth_token [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 20:29:00 user devstack@n-api.service[61908]: WARNING keystonemiddleware.auth_token [None req-51d7a629-9af1-4935-a7ed-5a78dc88f732 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 20:29:00 user devstack@n-api.service[61908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d93083990 pid: 61908 (default app) Apr 11 20:29:00 user devstack@n-api.service[61907]: WARNING keystonemiddleware.auth_token [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 20:29:00 user devstack@n-api.service[61907]: WARNING keystonemiddleware.auth_token [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 20:29:00 user devstack@n-api.service[61907]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d93083990 pid: 61907 (default app) Apr 11 20:31:08 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:08 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e27b8961-d38f-43ff-99e8-d6f0f4811e05 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001701 Apr 11 20:31:08 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:08 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:08 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:08 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:08 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:08 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:08 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-0630eab8-d1ce-4a55-90c4-cec74eca106a admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:08 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-0630eab8-d1ce-4a55-90c4-cec74eca106a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.436635 Apr 11 20:31:08 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 20:31:08 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002181 Apr 11 20:31:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:10 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-565450d3-87cd-4779-98b5-9b6721cdadb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:10 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-565450d3-87cd-4779-98b5-9b6721cdadb0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.320231 Apr 11 20:31:10 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:10 2023] POST /compute/v2.1/flavors => generated 405 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e01508a8-dcaa-48f4-a3e7-10ca912bac52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e01508a8-dcaa-48f4-a3e7-10ca912bac52 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049515 Apr 11 20:31:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 20:31:10 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001395 Apr 11 20:31:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5840b241-e08a-4e09-84ca-4f134965da6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5840b241-e08a-4e09-84ca-4f134965da6a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066504 Apr 11 20:31:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:12 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6bb708fb-4518-422f-b895-2ef87101ede0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6bb708fb-4518-422f-b895-2ef87101ede0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029665 Apr 11 20:31:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 20:31:12 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:14 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002199 Apr 11 20:31:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:14 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:14 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-42987713-78e5-4cda-aec4-6c5525ab8e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-42987713-78e5-4cda-aec4-6c5525ab8e76 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060118 Apr 11 20:31:14 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:14 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:14 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6a0b6a92-d3f9-4342-89a8-948244e68b9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:14 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6a0b6a92-d3f9-4342-89a8-948244e68b9a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027449 Apr 11 20:31:14 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 20:31:14 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001510 Apr 11 20:31:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0bdc57bb-e7e5-4d1e-aefe-833822467857 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0bdc57bb-e7e5-4d1e-aefe-833822467857 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057662 Apr 11 20:31:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-aae37967-50ba-41dc-9018-4389f0575be1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:16 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-aae37967-50ba-41dc-9018-4389f0575be1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027800 Apr 11 20:31:16 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 20:31:16 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001895 Apr 11 20:31:18 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:18 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-37abc472-96df-4dc0-939a-8f2585e6e36e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-37abc472-96df-4dc0-939a-8f2585e6e36e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.056548 Apr 11 20:31:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024759 Apr 11 20:31:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 20:31:18 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e357b853-cb31-43ad-9247-ab7319d7bc39 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001416 Apr 11 20:31:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:20 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3ec67b18-29e3-49e8-9651-285b819a8724 admin admin] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:20 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-3ec67b18-29e3-49e8-9651-285b819a8724 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.087326 Apr 11 20:31:20 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 20:31:20 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:31:23 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:23 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002756 Apr 11 20:31:23 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:23 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:23 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:23 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:23 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:23 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:31:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-55760537-7c75-476b-84a3-863af2f8068d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 1, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-55760537-7c75-476b-84a3-863af2f8068d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.357431 Apr 11 20:31:23 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:23 2023] POST /compute/v2.1/flavors => generated 400 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:23 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ae65b119-846a-4cc6-a790-83c1d043dd65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ae65b119-846a-4cc6-a790-83c1d043dd65 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035219 Apr 11 20:31:23 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 20:31:23 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001322 Apr 11 20:31:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-953aee5a-bb18-48ac-a355-05ffe12774f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-953aee5a-bb18-48ac-a355-05ffe12774f6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.058514 Apr 11 20:31:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:25 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e330b2d7-a671-444d-8aec-2d7499e1f71f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e330b2d7-a671-444d-8aec-2d7499e1f71f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029693 Apr 11 20:31:25 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 20:31:25 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:31:27 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001335 Apr 11 20:31:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:27 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d744dfeb-97d3-4596-ab1a-f7c7aaa1c502 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d744dfeb-97d3-4596-ab1a-f7c7aaa1c502 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.065280 Apr 11 20:31:27 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:27 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-a61bc1c5-5b78-48ff-954c-f5e0af6eb1a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:27 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-a61bc1c5-5b78-48ff-954c-f5e0af6eb1a5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024728 Apr 11 20:31:27 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 20:31:27 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:29 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001591 Apr 11 20:31:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:29 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c345cae3-8433-4598-8834-df771f1c1521 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 80, "name": "m1.large"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c345cae3-8433-4598-8834-df771f1c1521 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.065387 Apr 11 20:31:29 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:29 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:29 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f9a34173-cd5f-4c17-a56e-18b4c15f960b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f9a34173-cd5f-4c17-a56e-18b4c15f960b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026664 Apr 11 20:31:29 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 20:31:29 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:31:31 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:31:31 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001376 Apr 11 20:31:31 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 20:31:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:31:31 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-7827beb9-e502-487e-b0a0-9636760c8697 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "id": "5", "disk": 160}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-7827beb9-e502-487e-b0a0-9636760c8697 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082950 Apr 11 20:31:31 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 20:31:31 2023] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:31:31 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-6b4ab6dc-ec80-4143-ad34-456f9870ad14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:31:31 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-6b4ab6dc-ec80-4143-ad34-456f9870ad14 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025821 Apr 11 20:31:31 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 20:31:31 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:32:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:32:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30d1c91d-d81b-47fc-bf92-1945859d1a9b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002558 Apr 11 20:32:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 20:32:02 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:32:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:32:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.132583 Apr 11 20:32:02 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 20:32:02 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:32:35 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-6b4ab6dc-ec80-4143-ad34-456f9870ad14 admin admin] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:32:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-6b4ab6dc-ec80-4143-ad34-456f9870ad14 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001496 Apr 11 20:32:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 20:32:35 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:32:35 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:32:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ecdd7d10-9fd7-437f-bb87-0e106b759495 admin admin] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:32:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ecdd7d10-9fd7-437f-bb87-0e106b759495 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.070276 Apr 11 20:32:35 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 20:32:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:32:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:32:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001534 Apr 11 20:32:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 20:32:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:32:40 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:32:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-40852ea8-ec08-4b35-a7d6-57f47eb44e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.nano", "os-flavor-access:is_public": true, "disk": 1, "id": "42", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:32:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-40852ea8-ec08-4b35-a7d6-57f47eb44e89 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062999 Apr 11 20:32:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 20:32:40 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:32:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5af71245-cbe2-4dd4-a1e2-da3c687b4f79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:32:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5af71245-cbe2-4dd4-a1e2-da3c687b4f79 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028290 Apr 11 20:32:40 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 20:32:40 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:32:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:32:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-069d279f-f3d0-481a-a42a-a7f0bf581f7a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001863 Apr 11 20:32:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 20:32:44 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:32:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-798c3c40-31cf-4975-8bb6-1ff191bc8858 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "name": "m1.micro", "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:32:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-798c3c40-31cf-4975-8bb6-1ff191bc8858 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068948 Apr 11 20:32:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 20:32:44 2023] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:32:44 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-203c4771-889f-4d87-887d-a27f3b50fc6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:32:44 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-203c4771-889f-4d87-887d-a27f3b50fc6c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028199 Apr 11 20:32:44 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 20:32:44 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:34:57 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:34:57 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:34:57 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-94ba3d5f-abdb-4ab3-91f2-5bd8eba626a8 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Action: 'create', calling method: .version_select at 0x7f7269405510>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-713065414", "metadata": {"Type": "work"}}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-94ba3d5f-abdb-4ab3-91f2-5bd8eba626a8 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Request method failure captured: Apr 11 20:34:58 user devstack@n-api.service[61907]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 20:34:58 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:34:58 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:34:58 user devstack@n-api.service[61907]: Connection: close Apr 11 20:34:58 user devstack@n-api.service[61907]: Content-Length: 121 Apr 11 20:34:58 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:34:58 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:34:58 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:34:58 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcRxkclP5PgBZ88ibg422oOAvXY9SNWs1jRD_k63TQ3Sdgib__OaKgmnvQmNkCLc1sV4elGJo17a3SHDUPd4941Ty6iMvvWmjGDWK5oD5iIRGdSW6CDXVjAHMFxPBWpPOYNlF2AdEml4EPmG4ewllVd64sD2Cu3ZbOIfgOu8sqbFvBE Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Id: e956157342aa48a283d173dc9ba35cdf Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Name: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61907]: Apr 11 20:34:58 user devstack@n-api.service[61907]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-713065414", "metadata": {"Type": "work"}}} Apr 11 20:34:58 user devstack@n-api.service[61907]: method: Apr 11 20:34:58 user devstack@n-api.service[61907]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61907]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-713065414', 'metadata': {'Type': 'work'}}}} Apr 11 20:34:58 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise error Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-94ba3d5f-abdb-4ab3-91f2-5bd8eba626a8 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:34:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-94ba3d5f-abdb-4ab3-91f2-5bd8eba626a8 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.330248 Apr 11 20:34:58 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 20:34:57 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:34:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b6ef8925-a066-4998-9069-b6e29a5491e9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Action: 'create', calling method: .version_select at 0x7f7269597400>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1559286539", "metadata": {"Type": "work"}}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:34:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b6ef8925-a066-4998-9069-b6e29a5491e9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Request method failure captured: Apr 11 20:34:58 user devstack@n-api.service[61909]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 20:34:58 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:34:58 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:34:58 user devstack@n-api.service[61909]: Connection: close Apr 11 20:34:58 user devstack@n-api.service[61909]: Content-Length: 120 Apr 11 20:34:58 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:34:58 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:34:58 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:34:58 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcRxkclP5PgBZ88ibg422oOAvXY9SNWs1jRD_k63TQ3Sdgib__OaKgmnvQmNkCLc1sV4elGJo17a3SHDUPd4941Ty6iMvvWmjGDWK5oD5iIRGdSW6CDXVjAHMFxPBWpPOYNlF2AdEml4EPmG4ewllVd64sD2Cu3ZbOIfgOu8sqbFvBE Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Project-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Tenant-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61909]: X-User: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61909]: X-User-Id: e956157342aa48a283d173dc9ba35cdf Apr 11 20:34:58 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61909]: Apr 11 20:34:58 user devstack@n-api.service[61909]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1559286539", "metadata": {"Type": "work"}}} Apr 11 20:34:58 user devstack@n-api.service[61909]: method: Apr 11 20:34:58 user devstack@n-api.service[61909]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 20:34:58 user devstack@n-api.service[61909]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1559286539', 'metadata': {'Type': 'work'}}}} Apr 11 20:34:58 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise error Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi '0' Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 20:34:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b6ef8925-a066-4998-9069-b6e29a5491e9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:34:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b6ef8925-a066-4998-9069-b6e29a5491e9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012467 Apr 11 20:34:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 20:34:58 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:34:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fde2edfa-0111-4ca4-9963-022995d99bc0 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Action: 'create', calling method: .version_select at 0x7f72695629e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-343583546", "metadata": {"Type": "work"}}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:34:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fde2edfa-0111-4ca4-9963-022995d99bc0 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Request method failure captured: Apr 11 20:34:58 user devstack@n-api.service[61908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 20:34:58 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:34:58 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:34:58 user devstack@n-api.service[61908]: Connection: close Apr 11 20:34:58 user devstack@n-api.service[61908]: Content-Length: 118 Apr 11 20:34:58 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:34:58 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:34:58 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:34:58 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcRxkclP5PgBZ88ibg422oOAvXY9SNWs1jRD_k63TQ3Sdgib__OaKgmnvQmNkCLc1sV4elGJo17a3SHDUPd4941Ty6iMvvWmjGDWK5oD5iIRGdSW6CDXVjAHMFxPBWpPOYNlF2AdEml4EPmG4ewllVd64sD2Cu3ZbOIfgOu8sqbFvBE Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Project-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Project-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Tenant: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Tenant-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61908]: X-User: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61908]: X-User-Id: e956157342aa48a283d173dc9ba35cdf Apr 11 20:34:58 user devstack@n-api.service[61908]: X-User-Name: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61908]: Apr 11 20:34:58 user devstack@n-api.service[61908]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-343583546", "metadata": {"Type": "work"}}} Apr 11 20:34:58 user devstack@n-api.service[61908]: method: Apr 11 20:34:58 user devstack@n-api.service[61908]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61908]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-343583546', 'metadata': {'Type': 'work'}}}} Apr 11 20:34:58 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise error Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi '' Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 20:34:58 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fde2edfa-0111-4ca4-9963-022995d99bc0 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:34:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-fde2edfa-0111-4ca4-9963-022995d99bc0 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013269 Apr 11 20:34:58 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 20:34:58 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-3a83ae69-8586-476e-b2e3-08bb5cd31515 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Calling method '.version_select at 0x7f7269fefd00>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:34:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-3a83ae69-8586-476e-b2e3-08bb5cd31515 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] HTTP exception thrown: Volume tempest-invalid-1636636519 could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-3a83ae69-8586-476e-b2e3-08bb5cd31515 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Request method failure captured: Apr 11 20:34:58 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1636636519 HTTP/1.1 Apr 11 20:34:58 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:34:58 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:34:58 user devstack@n-api.service[61907]: Connection: close Apr 11 20:34:58 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:34:58 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:34:58 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:34:58 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:34:58 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcRxkclP5PgBZ88ibg422oOAvXY9SNWs1jRD_k63TQ3Sdgib__OaKgmnvQmNkCLc1sV4elGJo17a3SHDUPd4941Ty6iMvvWmjGDWK5oD5iIRGdSW6CDXVjAHMFxPBWpPOYNlF2AdEml4EPmG4ewllVd64sD2Cu3ZbOIfgOu8sqbFvBE Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Id: e956157342aa48a283d173dc9ba35cdf Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Name: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61907]: method: Apr 11 20:34:58 user devstack@n-api.service[61907]: exception: Volume tempest-invalid-1636636519 could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: action_args: {'id': 'tempest-invalid-1636636519'} Apr 11 20:34:58 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1636636519 could not be found. (HTTP 404) (Request-ID: req-5ae2197e-c6e9-4fc1-bfb8-e7d5d29bd062) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1636636519 could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1636636519 could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1636636519 could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-3a83ae69-8586-476e-b2e3-08bb5cd31515 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Returning 404 to user: Volume tempest-invalid-1636636519 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:34:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-3a83ae69-8586-476e-b2e3-08bb5cd31515 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1636636519" status: 404 len: 99 microversion: 2.1 time: 0.543666 Apr 11 20:34:58 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:34:58 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1636636519 => generated 99 bytes in 545 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ed204ef8-bdc9-4ead-87b1-2c0fb21a62ff tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004911 Apr 11 20:34:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 20:34:58 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-061d779f-03c4-4a2e-b364-d3cb8a4c64f7 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014287 Apr 11 20:34:58 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 20:34:58 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-cae2c110-9dff-474b-a074-f3e4f480915d tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Calling method '.version_select at 0x7f72693145e0>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:34:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-cae2c110-9dff-474b-a074-f3e4f480915d tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] HTTP exception thrown: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-cae2c110-9dff-474b-a074-f3e4f480915d tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Request method failure captured: Apr 11 20:34:58 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/os-volumes/9122f5e6-4e94-4839-83b6-1cf1447fdf6f HTTP/1.1 Apr 11 20:34:58 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:34:58 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:34:58 user devstack@n-api.service[61907]: Connection: close Apr 11 20:34:58 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:34:58 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:34:58 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:34:58 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:34:58 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcRxkclP5PgBZ88ibg422oOAvXY9SNWs1jRD_k63TQ3Sdgib__OaKgmnvQmNkCLc1sV4elGJo17a3SHDUPd4941Ty6iMvvWmjGDWK5oD5iIRGdSW6CDXVjAHMFxPBWpPOYNlF2AdEml4EPmG4ewllVd64sD2Cu3ZbOIfgOu8sqbFvBE Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Project-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Id: e956157342aa48a283d173dc9ba35cdf Apr 11 20:34:58 user devstack@n-api.service[61907]: X-User-Name: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:58 user devstack@n-api.service[61907]: method: Apr 11 20:34:58 user devstack@n-api.service[61907]: exception: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: action_args: {'id': '9122f5e6-4e94-4839-83b6-1cf1447fdf6f'} Apr 11 20:34:58 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. (HTTP 404) (Request-ID: req-3865f622-9768-4a9e-ace9-d10ca7fa431d) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. Apr 11 20:34:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:34:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-cae2c110-9dff-474b-a074-f3e4f480915d tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Returning 404 to user: Volume 9122f5e6-4e94-4839-83b6-1cf1447fdf6f could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:34:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-cae2c110-9dff-474b-a074-f3e4f480915d tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9122f5e6-4e94-4839-83b6-1cf1447fdf6f" status: 404 len: 109 microversion: 2.1 time: 0.043886 Apr 11 20:34:58 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:34:58 2023] DELETE /compute/v2.1/os-volumes/9122f5e6-4e94-4839-83b6-1cf1447fdf6f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:34:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-241d262f-fdde-4fea-b77f-c0be5597f5d9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Calling method '.version_select at 0x7f7269597c70>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:34:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-241d262f-fdde-4fea-b77f-c0be5597f5d9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] HTTP exception thrown: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. Apr 11 20:34:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-241d262f-fdde-4fea-b77f-c0be5597f5d9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Request method failure captured: Apr 11 20:34:59 user devstack@n-api.service[61909]: request: GET /compute/v2.1/os-volumes/d6728f55-a96f-4da2-b88c-cd917e4da85a HTTP/1.1 Apr 11 20:34:59 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:34:59 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:34:59 user devstack@n-api.service[61909]: Connection: close Apr 11 20:34:59 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:34:59 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:34:59 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:34:59 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:34:59 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcRxkclP5PgBZ88ibg422oOAvXY9SNWs1jRD_k63TQ3Sdgib__OaKgmnvQmNkCLc1sV4elGJo17a3SHDUPd4941Ty6iMvvWmjGDWK5oD5iIRGdSW6CDXVjAHMFxPBWpPOYNlF2AdEml4EPmG4ewllVd64sD2Cu3ZbOIfgOu8sqbFvBE Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Project-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f08d11edd4de4840baaf54a7fd5d4777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Tenant-Id: f08d11edd4de4840baaf54a7fd5d4777 Apr 11 20:34:59 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesNegativeTest-765377061 Apr 11 20:34:59 user devstack@n-api.service[61909]: X-User: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:59 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:34:59 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:34:59 user devstack@n-api.service[61909]: X-User-Id: e956157342aa48a283d173dc9ba35cdf Apr 11 20:34:59 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesNegativeTest-765377061-project-member Apr 11 20:34:59 user devstack@n-api.service[61909]: method: Apr 11 20:34:59 user devstack@n-api.service[61909]: exception: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. Apr 11 20:34:59 user devstack@n-api.service[61909]: action_args: {'id': 'd6728f55-a96f-4da2-b88c-cd917e4da85a'} Apr 11 20:34:59 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. (HTTP 404) (Request-ID: req-eacfe37d-6328-4af5-8c87-b2fb22fd4968) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. Apr 11 20:34:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:34:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-241d262f-fdde-4fea-b77f-c0be5597f5d9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] Returning 404 to user: Volume d6728f55-a96f-4da2-b88c-cd917e4da85a could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:34:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-241d262f-fdde-4fea-b77f-c0be5597f5d9 tempest-VolumesNegativeTest-765377061 tempest-VolumesNegativeTest-765377061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d6728f55-a96f-4da2-b88c-cd917e4da85a" status: 404 len: 109 microversion: 2.1 time: 0.328594 Apr 11 20:34:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 20:34:58 2023] GET /compute/v2.1/os-volumes/d6728f55-a96f-4da2-b88c-cd917e4da85a => generated 109 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:35:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1204998430", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "85e1d37e-b115-421f-9534-37865673ff59"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1b01863a-903f-4774-bfbc-dab361095018 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'create', calling method: .version_select at 0x7f7269314670>, body: {"keypair": {"name": "tempest-keypair-1950690295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR9qqL3LAGODqH+Z+1EkQCpgM8apAvzyB/jSy1MSWBRkUN4MsKV/vwwKd/cnP2giBycseEQJi5Z0VeYGnUBpd0fbzhscsD5KYv7mXFpxsVb4OZ8zQ+33MPkGmZFDcxTSg=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:18 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] validate_networks() for [('85e1d37e-b115-421f-9534-37865673ff59', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:18 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-1b01863a-903f-4774-bfbc-dab361095018 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for project 0d5fce55f8224068805593f94d5f2d36. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:18 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-1b01863a-903f-4774-bfbc-dab361095018 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for user f82468d207064eb288a2c8a167cd7d9d and project 0d5fce55f8224068805593f94d5f2d36. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1b01863a-903f-4774-bfbc-dab361095018 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.385697 Apr 11 20:35:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 18/54] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 20:35:18 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 388 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 20:35:20 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0a530f6a-60ad-4e33-bac9-3d0ce7aeedc3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'create', calling method: .version_select at 0x7f7269fad900>, body: {"keypair": {"name": "tempest-keypair-1169091087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA=="}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:20 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-0a530f6a-60ad-4e33-bac9-3d0ce7aeedc3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:20 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-0a530f6a-60ad-4e33-bac9-3d0ce7aeedc3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:20 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0a530f6a-60ad-4e33-bac9-3d0ce7aeedc3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.264711 Apr 11 20:35:20 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:35:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Getting quotas for project 0987ef9e9d6848ce9936af3567da53a2. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Getting quotas for user febd86b9e597436dae2b8c702aff1e8e and project 0987ef9e9d6848ce9936af3567da53a2. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:20 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.870631 Apr 11 20:35:21 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 18/56] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:35:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 2872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 20:35:21 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-5a224228-a12f-41ca-baca-ae8ab6ea0e4c tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:21 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5a224228-a12f-41ca-baca-ae8ab6ea0e4c tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:21 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-5a224228-a12f-41ca-baca-ae8ab6ea0e4c tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febd86b9e597436dae2b8c702aff1e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0987ef9e9d6848ce9936af3567da53a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-5a224228-a12f-41ca-baca-ae8ab6ea0e4c tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 200 len: 1209 microversion: 2.1 time: 0.207171 Apr 11 20:35:21 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:35:21 2023] GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:35:24 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1482156858", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "88ce8103-e878-4fd8-b5cc-78a05d373fc5"}], "security_groups": [{"name": "tempest-securitygroup--746239506"}], "key_name": "tempest-keypair-1950690295", "user_data": "}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:24 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] validate_networks() for [('88ce8103-e878-4fd8-b5cc-78a05d373fc5', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4025f060-931c-4abd-a501-dcbcef87d7bd tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Action: 'create', calling method: .version_select at 0x7f72694bc940>, body: {"keypair": {"name": "tempest-keypair-2032053389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8edukNlRzRt2xM1Yz79RSQhOkxsm8ccsONALiSEdR71l6YiK0hGivRdMEIPe6FhH/dBsOBuEPFT6mch0ytfQkkG8lca42/DiYBmO2hVEc7hq5brWI1oZCdGBeI4245iw=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:25 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-4025f060-931c-4abd-a501-dcbcef87d7bd tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting quotas for project e8329ebeb037462d864dd5cf8aefc6b8. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:25 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-4025f060-931c-4abd-a501-dcbcef87d7bd tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting quotas for user 127b201d67de4bacaed034d4becdc955 and project e8329ebeb037462d864dd5cf8aefc6b8. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4025f060-931c-4abd-a501-dcbcef87d7bd tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.404070 Apr 11 20:35:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:35:24 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for project 0d5fce55f8224068805593f94d5f2d36. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for user f82468d207064eb288a2c8a167cd7d9d and project 0d5fce55f8224068805593f94d5f2d36. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:26 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 2.059967 Apr 11 20:35:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 21/59] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:35:24 2023] POST /compute/v2.1/servers => generated 399 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:35:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a927ccdf-9195-4cc3-9e05-84b5594104b0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:26 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a927ccdf-9195-4cc3-9e05-84b5594104b0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-a927ccdf-9195-4cc3-9e05-84b5594104b0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-a927ccdf-9195-4cc3-9e05-84b5594104b0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-a927ccdf-9195-4cc3-9e05-84b5594104b0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a927ccdf-9195-4cc3-9e05-84b5594104b0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1276 microversion: 2.20 time: 0.135255 Apr 11 20:35:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:35:26 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:35:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-120119093", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c"}], "security_groups": [{"name": "tempest-securitygroup--449689845"}], "key_name": "tempest-keypair-1169091087", "user_data": "}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:27 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] validate_networks() for [('d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:28 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.397236 Apr 11 20:35:28 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:35:26 2023] POST /compute/v2.1/servers => generated 406 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:35:28 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-aab74141-762b-4bc7-a195-10cc991f2ddb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:28 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-aab74141-762b-4bc7-a195-10cc991f2ddb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:28 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-aab74141-762b-4bc7-a195-10cc991f2ddb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:28 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-aab74141-762b-4bc7-a195-10cc991f2ddb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1232 microversion: 2.1 time: 0.182768 Apr 11 20:35:28 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:35:28 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1232 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7831232f-c75e-4403-919d-bc2d69b659e5", "tag": "9e9edf73-7af6-41ad-9e04-9528f3dde81a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Creating event network-changed:9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance 7831232f-c75e-4403-919d-bc2d69b659e5 on user Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61907) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Acquired lock "compute-rpcapi-router" {{(pid=61907) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:29 user devstack@n-api.service[61907]: INFO nova.compute.rpcapi [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 20:35:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] Releasing lock "compute-rpcapi-router" {{(pid=61907) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 20:35:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-85d48a19-143b-4c64-b65f-581aaf12e057 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151417 Apr 11 20:35:29 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:31 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1743051561", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0"}], "security_groups": [{"name": "tempest-securitygroup--1880973277"}], "key_name": "tempest-keypair-2032053389", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:32 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] validate_networks() for [('ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Creating event network-changed:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61909) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61909) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:32 user devstack@n-api.service[61909]: INFO nova.compute.rpcapi [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 20:35:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] Releasing lock "compute-rpcapi-router" {{(pid=61909) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 20:35:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-73854238-2ac0-4e58-9d84-f81f32324712 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259703 Apr 11 20:35:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:34 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting quotas for project e8329ebeb037462d864dd5cf8aefc6b8. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:34 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting quotas for user 127b201d67de4bacaed034d4becdc955 and project e8329ebeb037462d864dd5cf8aefc6b8. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.481798 Apr 11 20:35:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:35:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:35:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-08c087ff-817c-41fa-a97f-8aba39b9c7b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-08c087ff-817c-41fa-a97f-8aba39b9c7b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:34 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-08c087ff-817c-41fa-a97f-8aba39b9c7b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-08c087ff-817c-41fa-a97f-8aba39b9c7b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1240 microversion: 2.1 time: 0.370084 Apr 11 20:35:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:35:34 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1240 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:35:34 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-091d35fb-51e4-451b-bef0-65fc074a26b4 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Action: 'create', calling method: .version_select at 0x7f7268a19870>, body: {"keypair": {"name": "tempest-keypair-208847137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHMuKtVqAgzsp5/expcX1bSxUaW1NpVgPU1mtUX80BTfPGihWz8OjN8J0Als+77YSgxutHOeytPJue1OlY4uegNXWVZVzcmOsVm9ZJdBkbHsA7NF/lHdxwZKph7epnUIA=="}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:34 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-091d35fb-51e4-451b-bef0-65fc074a26b4 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Getting quotas for project 2f2a37d13cdd4a8f90c4cd205d4f8b76. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:34 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-091d35fb-51e4-451b-bef0-65fc074a26b4 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Getting quotas for user 8f180b6f746141ae9e52234fd8804b29 and project 2f2a37d13cdd4a8f90c4cd205d4f8b76. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:34 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-091d35fb-51e4-451b-bef0-65fc074a26b4 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069049 Apr 11 20:35:34 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 24/67] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:35:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Creating event network-changed:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61908) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61908) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:37 user devstack@n-api.service[61908]: INFO nova.compute.rpcapi [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 20:35:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] Releasing lock "compute-rpcapi-router" {{(pid=61908) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 20:35:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7918c236-3d2c-499a-8f8a-76c9dd4ee80d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170917 Apr 11 20:35:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7831232f-c75e-4403-919d-bc2d69b659e5", "name": "network-vif-plugged", "status": "completed", "tag": "9e9edf73-7af6-41ad-9e04-9528f3dde81a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Creating event network-vif-plugged:9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance 7831232f-c75e-4403-919d-bc2d69b659e5 on user Apr 11 20:35:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034150 Apr 11 20:35:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:38 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ca4b6f36-ea81-4c9a-8423-0432fce6f711 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Action: 'create', calling method: .version_select at 0x7f72693ca7a0>, body: {"keypair": {"name": "tempest-keypair-189322231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW/t9YZ66Cz3VZyVg3QGLDVCdTkc7Tgb97mAXHXYB6LoyZLSe0s0IjH7upGLuhJ75+s83H49TRIFzJlt1rme3byHdLvFn1IUIl2DAKKNpuUl7UzAvXGLqeDLFOTod8Glg=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:38 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-ca4b6f36-ea81-4c9a-8423-0432fce6f711 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting quotas for project 0ab02b2eef8d40f18b755b63d2a14c9b. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:38 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-ca4b6f36-ea81-4c9a-8423-0432fce6f711 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting quotas for user af25924dd6564739a52fd957edceb143 and project 0ab02b2eef8d40f18b755b63d2a14c9b. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ca4b6f36-ea81-4c9a-8423-0432fce6f711 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.428010 Apr 11 20:35:38 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:35:38 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7831232f-c75e-4403-919d-bc2d69b659e5", "name": "network-vif-plugged", "status": "completed", "tag": "9e9edf73-7af6-41ad-9e04-9528f3dde81a"}, {"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-plugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Creating event network-vif-plugged:9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance 7831232f-c75e-4403-919d-bc2d69b659e5 on user Apr 11 20:35:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Creating event network-vif-plugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:35:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-717469447", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "41ed6326-30da-42e7-bb95-82da2c779cb8"}], "security_groups": [{"name": "tempest-securitygroup--296195786"}], "key_name": "tempest-keypair-208847137", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084938 Apr 11 20:35:40 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:35:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065482 Apr 11 20:35:41 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:41 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] validate_networks() for [('41ed6326-30da-42e7-bb95-82da2c779cb8', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Creating event network-changed:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:35:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075086 Apr 11 20:35:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-plugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Creating event network-vif-plugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:35:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047554 Apr 11 20:35:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:43 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Getting quotas for project 2f2a37d13cdd4a8f90c4cd205d4f8b76. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:43 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Getting quotas for user 8f180b6f746141ae9e52234fd8804b29 and project 2f2a37d13cdd4a8f90c4cd205d4f8b76. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:43 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:43 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:43 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:35:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083879 Apr 11 20:35:43 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:43 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.381825 Apr 11 20:35:43 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 26/76] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:35:40 2023] POST /compute/v2.1/servers => generated 403 bytes in 2386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:35:43 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-84e1e5c9-b028-47a7-8851-9a94de3bd1aa tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:43 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-84e1e5c9-b028-47a7-8851-9a94de3bd1aa tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:43 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-84e1e5c9-b028-47a7-8851-9a94de3bd1aa tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f180b6f746141ae9e52234fd8804b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a37d13cdd4a8f90c4cd205d4f8b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-84e1e5c9-b028-47a7-8851-9a94de3bd1aa tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934" status: 200 len: 1224 microversion: 2.1 time: 0.205501 Apr 11 20:35:43 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 26/77] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:35:43 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934 => generated 1224 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:35:45 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=22 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1907534775", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "f8c05312-c164-4467-85c1-b6d6a33e43db"}], "security_groups": [{"name": "tempest-securitygroup--1933683042"}], "key_name": "tempest-keypair-189322231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:45 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] validate_networks() for [('f8c05312-c164-4467-85c1-b6d6a33e43db', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting quotas for project 0ab02b2eef8d40f18b755b63d2a14c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting quotas for user af25924dd6564739a52fd957edceb143 and project 0ab02b2eef8d40f18b755b63d2a14c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:46 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.251671 Apr 11 20:35:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 26/78] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:35:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:35:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d63a2e95-1e4b-4fab-b800-483e57ebb74c tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:46 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d63a2e95-1e4b-4fab-b800-483e57ebb74c tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:46 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-59615f3a-f1d3-4403-a3a0-2364e986f67d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Action: 'create', calling method: .version_select at 0x7f72693ca950>, body: {"keypair": {"name": "tempest-keypair-1400889989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:46 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-59615f3a-f1d3-4403-a3a0-2364e986f67d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Getting quotas for project d40e31bd9e6e4d5e9cff3e4f2c1cf412. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:46 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-59615f3a-f1d3-4403-a3a0-2364e986f67d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Getting quotas for user 05684678d0cd4ccea78238d20d561f3f and project d40e31bd9e6e4d5e9cff3e4f2c1cf412. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-59615f3a-f1d3-4403-a3a0-2364e986f67d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.075827 Apr 11 20:35:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 27/79] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 20:35:46 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 11 20:35:46 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-d63a2e95-1e4b-4fab-b800-483e57ebb74c tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d63a2e95-1e4b-4fab-b800-483e57ebb74c tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1" status: 200 len: 1235 microversion: 2.1 time: 0.194968 Apr 11 20:35:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:35:46 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => generated 1235 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:35:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:35:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049141 Apr 11 20:35:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:49 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:49 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Creating event network-changed:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:35:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049730 Apr 11 20:35:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:49 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:35:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050087 Apr 11 20:35:49 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:50 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1083627248", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "f0dacc75-df3d-48cd-ac8f-1179c035c013"}], "security_groups": [{"name": "tempest-securitygroup--2054748500"}], "key_name": "tempest-keypair-1400889989", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:50 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=13 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:50 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] validate_networks() for [('f0dacc75-df3d-48cd-ac8f-1179c035c013', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=11 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=21 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Getting quotas for project d40e31bd9e6e4d5e9cff3e4f2c1cf412. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Getting quotas for user 05684678d0cd4ccea78238d20d561f3f and project d40e31bd9e6e4d5e9cff3e4f2c1cf412. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.603390 Apr 11 20:35:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 28/84] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:35:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-87d4f557-1da2-4107-8dcf-b954082f6e78 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-87d4f557-1da2-4107-8dcf-b954082f6e78 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-87d4f557-1da2-4107-8dcf-b954082f6e78 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=25 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8b508bb0-9fe4-4e2a-9b51-2c247479d28e tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Action: 'create', calling method: .version_select at 0x7f72693cb520>, body: {"keypair": {"name": "tempest-keypair-790069645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdT9m+B9YySsnmiLIjHxu4QvlA3mtfywAqzUXZhGrDg1cDaXTY+nvap6IYEGSvC+OLNvbuM7456Nky3u3j5bHxO363IT9g/IDQ0Kx0ome2u3RH00PsRCuHF5RqYu3myFg=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-87d4f557-1da2-4107-8dcf-b954082f6e78 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-87d4f557-1da2-4107-8dcf-b954082f6e78 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-87d4f557-1da2-4107-8dcf-b954082f6e78 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 200 len: 1321 microversion: 2.49 time: 0.221545 Apr 11 20:35:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:35:52 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:35:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Creating event network-changed:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:35:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092620 Apr 11 20:35:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:52 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=21 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:52 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-8b508bb0-9fe4-4e2a-9b51-2c247479d28e tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Getting quotas for project 284929c90a1e41559d5aa3885cd928b4. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:52 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-8b508bb0-9fe4-4e2a-9b51-2c247479d28e tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Getting quotas for user 77a83734398b4ac6bb576381f2557f76 and project 284929c90a1e41559d5aa3885cd928b4. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8b508bb0-9fe4-4e2a-9b51-2c247479d28e tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.593181 Apr 11 20:35:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:35:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "name": "network-vif-plugged", "status": "completed", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=13 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Creating event network-vif-plugged:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:35:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070446 Apr 11 20:35:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:35:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "name": "network-vif-plugged", "status": "completed", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Creating event network-vif-plugged:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:35:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050445 Apr 11 20:35:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2072587823", "imageRef": "b5d3e363-bdbc-4f56-9a89-97905d5b374b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b4cef739-4f35-4410-8e20-8dba69075711"}], "security_groups": [{"name": "tempest-securitygroup--1108392734"}], "key_name": "tempest-keypair-790069645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:55 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] validate_networks() for [('b4cef739-4f35-4410-8e20-8dba69075711', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:35:55 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:35:55 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "name": "network-vif-plugged", "status": "completed", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Creating event network-vif-plugged:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:35:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101285 Apr 11 20:35:56 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Getting quotas for project 284929c90a1e41559d5aa3885cd928b4. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Getting quotas for user 77a83734398b4ac6bb576381f2557f76 and project 284929c90a1e41559d5aa3885cd928b4. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:35:57 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5d3e363-bdbc-4f56-9a89-97905d5b374b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:35:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.316609 Apr 11 20:35:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 30/91] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:35:55 2023] POST /compute/v2.1/servers => generated 404 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:35:57 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e8ad9bfa-b3f5-40c4-b902-9834230cca4f tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:35:57 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e8ad9bfa-b3f5-40c4-b902-9834230cca4f tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:35:57 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-e8ad9bfa-b3f5-40c4-b902-9834230cca4f tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a83734398b4ac6bb576381f2557f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284929c90a1e41559d5aa3885cd928b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:35:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e8ad9bfa-b3f5-40c4-b902-9834230cca4f tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 200 len: 1239 microversion: 2.1 time: 0.129145 Apr 11 20:35:57 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 31/92] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:35:57 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 1239 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:35:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "name": "network-vif-plugged", "status": "completed", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:35:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:35:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:35:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:35:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Creating event network-vif-plugged:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:35:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086027 Apr 11 20:35:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:35:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:36:00 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Creating event network-changed:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:36:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075022 Apr 11 20:36:00 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-plugged", "status": "completed", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Creating event network-vif-plugged:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:36:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049609 Apr 11 20:36:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Creating event network-changed:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:36:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041059 Apr 11 20:36:02 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-plugged", "status": "completed", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Creating event network-vif-plugged:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:36:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051128 Apr 11 20:36:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:04 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:04 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ca2fb8ec-858a-46b1-ac2c-be077202be8b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Action: 'create', calling method: .version_select at 0x7f7268b84d30>, body: {"keypair": {"name": "tempest-keypair-1312085823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:04 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-ca2fb8ec-858a-46b1-ac2c-be077202be8b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting quotas for project caa968f4c38c40719e6169250097c718. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:36:04 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-ca2fb8ec-858a-46b1-ac2c-be077202be8b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting quotas for user d5d98b3ceee842b08adb37e62e68436e and project caa968f4c38c40719e6169250097c718. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:36:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ca2fb8ec-858a-46b1-ac2c-be077202be8b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.049345 Apr 11 20:36:04 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 33/98] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 20:36:04 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 20:36:06 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "name": "network-vif-plugged", "status": "completed", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}, {"server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "name": "network-vif-plugged", "status": "completed", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Creating event network-vif-plugged:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:36:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Creating event network-vif-plugged:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:36:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046172 Apr 11 20:36:06 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-27898241", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "4bd0e6c3-35c1-4e52-aa48-bebac03add01"}, {"port": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "tag": "port-1"}, {"port": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "tag": "port-2"}, {"uuid": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "tag": "net-1"}, {"uuid": "1132fd57-4fb8-42ff-b70e-665ae0200cda"}, {"uuid": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5b934599-7ca8-4454-92c2-a16987271127", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "97768c05-bc64-4bf6-83ae-4350d75b7320", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ca36a125-7c79-4bf4-8c28-9d1b798dceba", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1557201810"}], "key_name": "tempest-keypair-1312085823", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:07 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] validate_networks() for [('4bd0e6c3-35c1-4e52-aa48-bebac03add01', None, None, None, None, None), (None, None, '1bb7820c-fce7-4d0d-8d4c-4d506f0db38e', None, None, None), (None, None, '33b1d7c0-166a-4aa9-92b4-5b7d16637dc2', None, None, None), ('1132fd57-4fb8-42ff-b70e-665ae0200cda', None, None, None, None, None), ('1132fd57-4fb8-42ff-b70e-665ae0200cda', None, None, None, None, None), ('37c1d133-c3f1-4bd5-8af7-85380cc64d85', '10.2.2.100', None, None, None, None), ('37c1d133-c3f1-4bd5-8af7-85380cc64d85', '10.2.2.200', None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:36:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=9 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting quotas for project caa968f4c38c40719e6169250097c718. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:36:09 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting quotas for user d5d98b3ceee842b08adb37e62e68436e and project caa968f4c38c40719e6169250097c718. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:36:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:36:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5b934599-7ca8-4454-92c2-a16987271127',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='97768c05-bc64-4bf6-83ae-4350d75b7320',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca36a125-7c79-4bf4-8c28-9d1b798dceba',volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:36:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.540670 Apr 11 20:36:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 33/100] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 20:36:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 3543 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:36:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6629b4da-0f18-490b-93b9-ed127e33ad02 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6629b4da-0f18-490b-93b9-ed127e33ad02 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-6629b4da-0f18-490b-93b9-ed127e33ad02 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-6629b4da-0f18-490b-93b9-ed127e33ad02 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-6629b4da-0f18-490b-93b9-ed127e33ad02 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6629b4da-0f18-490b-93b9-ed127e33ad02 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 200 len: 1278 microversion: 2.32 time: 0.098848 Apr 11 20:36:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 34/101] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:36:10 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:11 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febd86b9e597436dae2b8c702aff1e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0987ef9e9d6848ce9936af3567da53a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ea8c50b6-1f20-48dd-b2d8-9a50e7c187a6 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 200 len: 1490 microversion: 2.1 time: 0.317597 Apr 11 20:36:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 35/102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:36:11 2023] GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 1490 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=15 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:16 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b8770a8f-7a19-4a3e-a948-a39b932ccfb4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1587 microversion: 2.20 time: 0.334159 Apr 11 20:36:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:36:16 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1587 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:36:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=7 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Creating event network-changed:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128249 Apr 11 20:36:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:18 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-639d04d4-ecd7-43a0-97e0-6f949331cd96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1538 microversion: 2.1 time: 0.199231 Apr 11 20:36:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:36:18 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1538 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:36:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e"}, {"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:20 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:20 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Creating event network-changed:1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Creating event network-changed:33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036125 Apr 11 20:36:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:20 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:22 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=20 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:22 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "532c5436-45ba-4503-a774-4fa206ce6f73"}, {"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "58994cba-fc42-41f3-9e7c-9d2c4048ba15"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:22 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Creating event network-changed:532c5436-45ba-4503-a774-4fa206ce6f73 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Creating event network-changed:58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047017 Apr 11 20:36:22 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:22 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:24 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "2279246f-00a6-4589-b12c-ca5ab19d54a7"}, {"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "c8d0aab1-4380-41a7-aeb6-3222168c5c52"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:24 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=18 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:24 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:24 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:24 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:24 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=22 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:24 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Creating event network-changed:2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:24 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Creating event network-changed:c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:24 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038942 Apr 11 20:36:24 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=7 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:24 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9f3c6963-5da5-438d-8fc3-dbe4bf0bd0b8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1553 microversion: 2.1 time: 0.190481 Apr 11 20:36:24 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:36:24 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:33 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f180b6f746141ae9e52234fd8804b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a37d13cdd4a8f90c4cd205d4f8b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-95af53e6-1f4b-4737-bf68-b6af00f945bb tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934" status: 200 len: 1523 microversion: 2.1 time: 0.252698 Apr 11 20:36:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:36:33 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:36:36 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:36 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Creating event network-vif-plugged:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045149 Apr 11 20:36:36 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=13 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:36 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-14a4ef2e-966e-4416-a336-663bf5f186e0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1" status: 200 len: 1543 microversion: 2.1 time: 0.217520 Apr 11 20:36:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:36:36 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => generated 1543 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:36:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Creating event network-vif-plugged:1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043046 Apr 11 20:36:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Creating event network-vif-plugged:33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039092 Apr 11 20:36:37 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:38 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "532c5436-45ba-4503-a774-4fa206ce6f73"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "532c5436-45ba-4503-a774-4fa206ce6f73"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Creating event network-vif-plugged:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Creating event network-vif-plugged:532c5436-45ba-4503-a774-4fa206ce6f73 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Creating event network-vif-plugged:532c5436-45ba-4503-a774-4fa206ce6f73 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037764 Apr 11 20:36:38 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "2279246f-00a6-4589-b12c-ca5ab19d54a7"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "2279246f-00a6-4589-b12c-ca5ab19d54a7"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Creating event network-vif-plugged:1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Creating event network-vif-plugged:2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Creating event network-vif-plugged:2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047822 Apr 11 20:36:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "58994cba-fc42-41f3-9e7c-9d2c4048ba15"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "58994cba-fc42-41f3-9e7c-9d2c4048ba15"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "c8d0aab1-4380-41a7-aeb6-3222168c5c52"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "c8d0aab1-4380-41a7-aeb6-3222168c5c52"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:36:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Creating event network-vif-plugged:33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Creating event network-vif-plugged:58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Creating event network-vif-plugged:58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Creating event network-vif-plugged:c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Creating event network-vif-plugged:c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:36:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.032953 Apr 11 20:36:39 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1af348f3-2aaf-4cf9-ac2e-237d42f47d23 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 200 len: 1627 microversion: 2.49 time: 0.215351 Apr 11 20:36:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 39/118] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:36:42 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 1627 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:36:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:36:48 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a83734398b4ac6bb576381f2557f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284929c90a1e41559d5aa3885cd928b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:36:48 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-22627ffd-ba3b-4f17-92ad-9c44ef17f326 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 200 len: 1549 microversion: 2.1 time: 0.162259 Apr 11 20:36:48 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 40/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:36:47 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e579912c-4c20-4d7e-a2c1-1e450d67c4d7 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 200 len: 2822 microversion: 2.32 time: 0.246091 Apr 11 20:37:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 41/120] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:37:00 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 2822 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fded504-789e-4265-a6f5-8b737bfb7630"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=14 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:13 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641922 Apr 11 20:37:13 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 40/121] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:37:13 2023] POST /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=16 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6db2a1ec-44b2-466f-951c-cc33c02e310f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.144009 Apr 11 20:37:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 41/122] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:37:16 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-interface => generated 282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:37:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Creating event network-changed:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:37:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053539 Apr 11 20:37:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-15aef52f-a872-4a08-96c1-bd34b3f8f3c6 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/ips" status: 200 len: 110 microversion: 2.20 time: 0.040293 Apr 11 20:37:18 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 41/124] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 20:37:18 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-927b1ec5-2c32-4676-8252-23e4ec286c1e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.103909 Apr 11 20:37:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 42/125] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:37:18 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Creating event network-changed:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:37:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Apr 11 20:37:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:20 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-40ae82a6-44eb-41b1-8898-c0f09d861d70 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1538 microversion: 2.1 time: 0.182603 Apr 11 20:37:20 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'flavor' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:37:20 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:37:19 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1538 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:20 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-52c2e076-fb38-4c10-88cf-4e954b626cc9 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1538 microversion: 2.1 time: 0.166717 Apr 11 20:37:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 43/128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:37:20 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1538 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:37:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/action" status: 202 len: 0 microversion: 2.20 time: 1.389660 Apr 11 20:37:21 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 43/129] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:37:19 2023] POST /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/action => generated 0 bytes in 1392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4a416e11-ed53-4007-8b90-999044e58cfa tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1712 microversion: 2.20 time: 0.163996 Apr 11 20:37:21 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 44/130] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:37:21 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-unplugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Creating event network-vif-unplugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:37:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037500 Apr 11 20:37:21 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:21 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:37:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 204 len: 0 microversion: 2.1 time: 0.142782 Apr 11 20:37:21 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 44/132] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:37:21 2023] DELETE /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:21 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febd86b9e597436dae2b8c702aff1e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0987ef9e9d6848ce9936af3567da53a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-bf03a12e-a9ff-4b45-86f4-f862aff9a00e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 200 len: 1542 microversion: 2.1 time: 0.214616 Apr 11 20:37:21 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 45/133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:37:21 2023] GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 1542 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:37:23 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-plugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}, {"server_uuid": "7831232f-c75e-4403-919d-bc2d69b659e5", "name": "network-vif-unplugged", "status": "completed", "tag": "9e9edf73-7af6-41ad-9e04-9528f3dde81a"}, {"server_uuid": "7831232f-c75e-4403-919d-bc2d69b659e5", "name": "network-vif-plugged", "status": "completed", "tag": "9e9edf73-7af6-41ad-9e04-9528f3dde81a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Creating event network-vif-plugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:37:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Creating event network-vif-unplugged:9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance 7831232f-c75e-4403-919d-bc2d69b659e5 on user Apr 11 20:37:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Creating event network-vif-plugged:9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance 7831232f-c75e-4403-919d-bc2d69b659e5 on user Apr 11 20:37:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.051628 Apr 11 20:37:23 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:23 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7831232f-c75e-4403-919d-bc2d69b659e5", "name": "network-vif-deleted", "tag": "9e9edf73-7af6-41ad-9e04-9528f3dde81a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] Creating event network-vif-deleted:9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance 7831232f-c75e-4403-919d-bc2d69b659e5 on user Apr 11 20:37:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037006 Apr 11 20:37:24 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-407eb8aa-d617-47ca-92db-8d27d27b817f tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.090415 Apr 11 20:37:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 46/136] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:37:24 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Creating event network-changed:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:37:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Apr 11 20:37:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1587032650"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Creating event network-changed:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029719 Apr 11 20:37:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/action" status: 202 len: 0 microversion: 2.1 time: 0.771213 Apr 11 20:37:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 47/139] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:37:26 2023] POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 20:37:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e038ec4d-1c8d-4b4d-a1a8-0ec14f02d7d0 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '.version_select at 0x7f7268a8d2d0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:27 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e038ec4d-1c8d-4b4d-a1a8-0ec14f02d7d0 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb" status: 200 len: 1609 microversion: 2.1 time: 0.048353 Apr 11 20:37:27 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 47/140] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 20:37:27 2023] GET /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb => generated 1609 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8f065798-911f-46f7-bcf4-914c6b4b0290 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.103886 Apr 11 20:37:33 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:37:33 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-interface => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Creating event network-changed:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:37:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033120 Apr 11 20:37:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54c1df9d-22e1-4a3b-a9f9-8200f8463170"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308829 Apr 11 20:37:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 48/143] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:37:34 2023] POST /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:37 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0b9e8daa-9f4c-4930-b182-af8f79704829 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.099771 Apr 11 20:37:37 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:37:37 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-interface => generated 282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:37:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Creating event network-changed:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:37:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037342 Apr 11 20:37:38 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1f1921-74f8-4bc3-a351-fa770d5ce07d"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299469 Apr 11 20:37:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 49/146] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:37:40 2023] POST /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b5508baa-4461-4b70-9b47-f0414d386013"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments/54c1df9d-22e1-4a3b-a9f9-8200f8463170" status: 202 len: 0 microversion: 2.1 time: 0.497617 Apr 11 20:37:43 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 49/147] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 20:37:42 2023] PUT /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments/54c1df9d-22e1-4a3b-a9f9-8200f8463170 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:37:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4e013a43-7ab2-4d56-b611-e85dd8fe8475 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.460541 Apr 11 20:37:43 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 50/148] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:37:42 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-interface => generated 282 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:37:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Creating event network-changed:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:37:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037938 Apr 11 20:37:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 50/149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:44 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:37:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-57a73213-7fe8-43e6-b228-06cdc6a3a221 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 200 len: 1627 microversion: 2.49 time: 0.249524 Apr 11 20:37:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 50/150] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:37:44 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 1627 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "b525da5e-39db-4d91-a875-33ce571afeb7", "tag": "nic-tag"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "tag": "96808211-12b7-43cd-8ca0-02265ff49938"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Creating event network-changed:96808211-12b7-43cd-8ca0-02265ff49938 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:37:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Apr 11 20:37:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 51/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:37:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-plugged", "status": "completed", "tag": "96808211-12b7-43cd-8ca0-02265ff49938"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Creating event network-vif-plugged:96808211-12b7-43cd-8ca0-02265ff49938 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:37:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Apr 11 20:37:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=23 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:47 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:48 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.606024 Apr 11 20:37:48 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 51/153] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 20:37:44 2023] POST /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-interface => generated 282 bytes in 3608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e76aa8dd-e32a-41c4-8881-5bbf9958a225", "tag": "volume-tag"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-386943a9-6f06-4046-94e2-b6a98a7d9504 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.100260 Apr 11 20:37:48 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 52/154] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:37:48 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:48 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:48 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.374969 Apr 11 20:37:48 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 52/155] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 20:37:48 2023] POST /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:37:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Creating event network-changed:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:37:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049667 Apr 11 20:37:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-plugged", "status": "completed", "tag": "96808211-12b7-43cd-8ca0-02265ff49938"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Creating event network-vif-plugged:96808211-12b7-43cd-8ca0-02265ff49938 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:37:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035099 Apr 11 20:37:49 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fce525a1-4c7b-4baa-974b-d0b6dd61c24f"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=21 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] HTTP exception thrown: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. Apr 11 20:37:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Request method failure captured: Apr 11 20:37:51 user devstack@n-api.service[61909]: request: PUT /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments/ed1f1921-74f8-4bc3-a351-fa770d5ce07d HTTP/1.1 Apr 11 20:37:51 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:37:51 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:37:51 user devstack@n-api.service[61909]: Connection: close Apr 11 20:37:51 user devstack@n-api.service[61909]: Content-Length: 74 Apr 11 20:37:51 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:37:51 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:37:51 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:37:51 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSaS3B_ZbCr3PFFytx_Ko3nF4ibMBiGvgudw-mMTlxe8qsR1hBLoMNwRPk7pKAZbK8Qn9rHYzJjMebQvsyQ1-JsREFItl1r1PmsThTSvq-f9i9QVCrRlPlbtnlUGMdUk53t_6PNJsMsfoJd52dvHmAQywZyoQtoMBrxZwIo1FqxMrw Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Project-Id: 26c922add32c42d2aad8f3f6a43e229b Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesAdminNegativeTest-194988579 Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Role: admin,member,reader Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Roles: admin,member,reader Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26c922add32c42d2aad8f3f6a43e229b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26c922add32c42d2aad8f3f6a43e229b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26c922add32c42d2aad8f3f6a43e229b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesAdminNegativeTest-194988579 Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Tenant-Id: 26c922add32c42d2aad8f3f6a43e229b Apr 11 20:37:51 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-194988579 Apr 11 20:37:51 user devstack@n-api.service[61909]: X-User: tempest-VolumesAdminNegativeTest-194988579-project-admin Apr 11 20:37:51 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:37:51 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:37:51 user devstack@n-api.service[61909]: X-User-Id: 942b82e3a8e14790acc12b7d79f0f1b6 Apr 11 20:37:51 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesAdminNegativeTest-194988579-project-admin Apr 11 20:37:51 user devstack@n-api.service[61909]: Apr 11 20:37:51 user devstack@n-api.service[61909]: {"volumeAttachment": {"volumeId": "fce525a1-4c7b-4baa-974b-d0b6dd61c24f"}} Apr 11 20:37:51 user devstack@n-api.service[61909]: method: > Apr 11 20:37:51 user devstack@n-api.service[61909]: exception: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. Apr 11 20:37:51 user devstack@n-api.service[61909]: action_args: {'server_id': '52b7250e-a85d-4c3f-93e7-ac05ebd13be1', 'id': 'ed1f1921-74f8-4bc3-a351-fa770d5ce07d', 'body': {'volumeAttachment': {'volumeId': 'fce525a1-4c7b-4baa-974b-d0b6dd61c24f'}}} Apr 11 20:37:51 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. (HTTP 404) (Request-ID: req-6b118a33-2650-40fc-ae9d-ca39bee55f8c) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. Apr 11 20:37:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:37:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Returning 400 to user: Volume fce525a1-4c7b-4baa-974b-d0b6dd61c24f could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:37:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-eb36376b-aebb-49a1-884a-1454f5d32d75 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments/ed1f1921-74f8-4bc3-a351-fa770d5ce07d" status: 400 len: 107 microversion: 2.1 time: 0.305468 Apr 11 20:37:51 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 53/158] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 20:37:50 2023] PUT /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments/ed1f1921-74f8-4bc3-a351-fa770d5ce07d => generated 107 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:51 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'services' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:37:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments/ed1f1921-74f8-4bc3-a351-fa770d5ce07d" status: 202 len: 0 microversion: 2.1 time: 0.342519 Apr 11 20:37:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 53/159] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:37:51 2023] DELETE /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments/ed1f1921-74f8-4bc3-a351-fa770d5ce07d => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:51 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-5778dbb0-bdc0-40cd-88a9-4a33105b5a01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087883 Apr 11 20:37:51 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:37:51 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0c7da85-751f-48ee-bcb9-3d2b8296dd79"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "POST /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431595 Apr 11 20:37:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 54/161] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:37:52 2023] POST /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:58 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'services' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:37:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-volume_attachments/e76aa8dd-e32a-41c4-8881-5bbf9958a225" status: 202 len: 0 microversion: 2.49 time: 0.286445 Apr 11 20:37:58 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 54/162] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 20:37:58 2023] DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-volume_attachments/e76aa8dd-e32a-41c4-8881-5bbf9958a225 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9d921ce7-89d2-4de4-9c52-92c748d60117 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Apr 11 20:37:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 55/163] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:37:59 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d4e06d11-8735-462c-a870-cc5bacb0eae7 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 Apr 11 20:37:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:37:59 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "54c1df9d-22e1-4a3b-a9f9-8200f8463170"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:37:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments/b5508baa-4461-4b70-9b47-f0414d386013" status: 202 len: 0 microversion: 2.1 time: 0.433273 Apr 11 20:38:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 55/165] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 20:37:59 2023] PUT /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments/b5508baa-4461-4b70-9b47-f0414d386013 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ea537b9c-4266-4e4a-892e-2f32c668e4cd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 Apr 11 20:38:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 56/166] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:01 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:01 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'services' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:38:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments/d0c7da85-751f-48ee-bcb9-3d2b8296dd79" status: 202 len: 0 microversion: 2.1 time: 0.234217 Apr 11 20:38:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:38:01 2023] DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments/d0c7da85-751f-48ee-bcb9-3d2b8296dd79 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:38:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-314f84b8-7c9e-4cf0-92d5-c7bf93e5a6b8 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.420268 Apr 11 20:38:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 56/168] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:38:01 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30/os-interface => generated 1828 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:38:02 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Creating event network-changed:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Apr 11 20:38:02 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 57/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:02 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-a8beb96d-d786-476c-8272-e12227832575 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 200 len: 2822 microversion: 2.32 time: 0.262462 Apr 11 20:38:02 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 57/170] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:38:02 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 2822 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d619bfe8-0ab3-4ad7-a0ab-ea657aa5c6fa tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.127447 Apr 11 20:38:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 57/171] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:38:02 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30/os-interface => generated 1828 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d3fb0b93-b3ea-4b2d-8a11-ca1722e5ffdd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047719 Apr 11 20:38:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:03 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-3cd4f27b-dafc-4bf9-a3a7-7ec390f02a70 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042768 Apr 11 20:38:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:03 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:38:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 204 len: 0 microversion: 2.1 time: 0.134278 Apr 11 20:38:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:38:03 2023] DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a83734398b4ac6bb576381f2557f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284929c90a1e41559d5aa3885cd928b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9e01595a-4c06-4ded-ae2f-553a9edf8079 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 200 len: 1673 microversion: 2.1 time: 0.162740 Apr 11 20:38:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 59/175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:03 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "name": "network-vif-unplugged", "status": "completed", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Creating event network-vif-unplugged:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:38:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043402 Apr 11 20:38:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:38:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 204 len: 0 microversion: 2.32 time: 0.131797 Apr 11 20:38:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 59/177] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:38:03 2023] DELETE /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:04 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:04 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:04 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-fdad0917-4d26-4ec8-9bd3-e9fe98dcb7d1 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 200 len: 2946 microversion: 2.32 time: 0.258065 Apr 11 20:38:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 60/178] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:38:03 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 2946 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:38:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Creating event network-vif-unplugged:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030654 Apr 11 20:38:04 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 60/179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:04 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Creating event network-vif-unplugged:33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033885 Apr 11 20:38:04 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-interface/96808211-12b7-43cd-8ca0-02265ff49938" status: 202 len: 0 microversion: 2.49 time: 0.113392 Apr 11 20:38:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 20:38:05 2023] DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-interface/96808211-12b7-43cd-8ca0-02265ff49938 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:38:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "name": "network-vif-plugged", "status": "completed", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "2279246f-00a6-4589-b12c-ca5ab19d54a7"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "2279246f-00a6-4589-b12c-ca5ab19d54a7"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Creating event network-vif-plugged:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:38:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Creating event network-vif-unplugged:1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Creating event network-vif-plugged:1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Creating event network-vif-unplugged:2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Creating event network-vif-plugged:2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.042417 Apr 11 20:38:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:05 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5adf5809-9928-4f58-842f-efdb74e058d6 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-instance-actions/req-4dfefc93-9c79-463d-8465-f727997d2a94" status: 200 len: 474 microversion: 2.49 time: 0.267902 Apr 11 20:38:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 20:38:05 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-instance-actions/req-4dfefc93-9c79-463d-8465-f727997d2a94 => generated 474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:38:06 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "532c5436-45ba-4503-a774-4fa206ce6f73"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "532c5436-45ba-4503-a774-4fa206ce6f73"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:06 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:06 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:06 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Creating event network-vif-plugged:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Creating event network-vif-unplugged:532c5436-45ba-4503-a774-4fa206ce6f73 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Creating event network-vif-plugged:532c5436-45ba-4503-a774-4fa206ce6f73 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.051472 Apr 11 20:38:06 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 62/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:06 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "58994cba-fc42-41f3-9e7c-9d2c4048ba15"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "58994cba-fc42-41f3-9e7c-9d2c4048ba15"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-unplugged", "status": "completed", "tag": "c8d0aab1-4380-41a7-aeb6-3222168c5c52"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-plugged", "status": "completed", "tag": "c8d0aab1-4380-41a7-aeb6-3222168c5c52"}, {"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-unplugged", "status": "completed", "tag": "96808211-12b7-43cd-8ca0-02265ff49938"}, {"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-plugged", "status": "completed", "tag": "96808211-12b7-43cd-8ca0-02265ff49938"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:06 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:06 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:06 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-plugged:33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-unplugged:58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-plugged:58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-unplugged:c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-plugged:c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-unplugged:96808211-12b7-43cd-8ca0-02265ff49938 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Creating event network-vif-plugged:96808211-12b7-43cd-8ca0-02265ff49938 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:38:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.135635 Apr 11 20:38:06 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 20:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674a4347-8da2-4455-8e90-0fd358b5f696", "name": "network-vif-deleted", "tag": "4bad185c-c76d-4162-8213-384229da15ca"}, {"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-deleted", "tag": "96808211-12b7-43cd-8ca0-02265ff49938"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] Creating event network-vif-deleted:4bad185c-c76d-4162-8213-384229da15ca for instance 674a4347-8da2-4455-8e90-0fd358b5f696 on user Apr 11 20:38:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] Creating event network-vif-deleted:96808211-12b7-43cd-8ca0-02265ff49938 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:38:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052748 Apr 11 20:38:07 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 62/186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-deleted", "tag": "58994cba-fc42-41f3-9e7c-9d2c4048ba15"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] Creating event network-vif-deleted:58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054618 Apr 11 20:38:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 63/187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5669b29a-a9ec-45af-8947-ccb4011d364e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1657 microversion: 2.1 time: 0.169757 Apr 11 20:38:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:10 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1657 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:10 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:10 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-25194c28-2fd9-4b3d-b635-16bcde6c6e96 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1657 microversion: 2.1 time: 0.154766 Apr 11 20:38:10 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:10 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:11 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:11 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-101c8caa-f468-477d-99e5-6be020b64823 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1653 microversion: 2.20 time: 0.187492 Apr 11 20:38:11 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 64/190] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:38:11 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1653 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] HTTP exception thrown: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Request method failure captured: Apr 11 20:38:11 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 HTTP/1.1 Apr 11 20:38:11 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:38:11 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:38:11 user devstack@n-api.service[61908]: Connection: close Apr 11 20:38:11 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:38:11 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:38:11 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:38:11 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:38:11 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSFDx5trYECo8OdVTl3caiFNHlArm-lIBcHvbDXVzOg_I8lczXiP4y7QgHX19qWoUsxmaFlZ2fXhnNRawsHYnGNEax9Y1DXheNNQKIMvqzcfSy8GnahEeSs442Si6j3Q8yAout8OjZfrats2xsiQoH-0hBqJUC9gXKpSq-DJN237tc Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Project-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Project-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Tenant: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Tenant-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:11 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:11 user devstack@n-api.service[61908]: X-User: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:11 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:38:11 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:38:11 user devstack@n-api.service[61908]: X-User-Id: febd86b9e597436dae2b8c702aff1e8e Apr 11 20:38:11 user devstack@n-api.service[61908]: X-User-Name: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:11 user devstack@n-api.service[61908]: method: > Apr 11 20:38:11 user devstack@n-api.service[61908]: exception: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:11 user devstack@n-api.service[61908]: action_args: {'id': '7831232f-c75e-4403-919d-bc2d69b659e5'} Apr 11 20:38:11 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:11 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Returning 404 to user: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-05c307ae-0446-42ff-9eb7-7374f1596b80 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 404 len: 111 microversion: 2.1 time: 0.033155 Apr 11 20:38:11 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:11 2023] GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] HTTP exception thrown: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Request method failure captured: Apr 11 20:38:12 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5/os-volume_attachments HTTP/1.1 Apr 11 20:38:12 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:38:12 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:38:12 user devstack@n-api.service[61909]: Connection: close Apr 11 20:38:12 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:38:12 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:38:12 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:38:12 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:38:12 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSFDx5trYECo8OdVTl3caiFNHlArm-lIBcHvbDXVzOg_I8lczXiP4y7QgHX19qWoUsxmaFlZ2fXhnNRawsHYnGNEax9Y1DXheNNQKIMvqzcfSy8GnahEeSs442Si6j3Q8yAout8OjZfrats2xsiQoH-0hBqJUC9gXKpSq-DJN237tc Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Project-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Project-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Tenant: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Tenant-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:12 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:12 user devstack@n-api.service[61909]: X-User: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:12 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:38:12 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:38:12 user devstack@n-api.service[61909]: X-User-Id: febd86b9e597436dae2b8c702aff1e8e Apr 11 20:38:12 user devstack@n-api.service[61909]: X-User-Name: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:12 user devstack@n-api.service[61909]: method: > Apr 11 20:38:12 user devstack@n-api.service[61909]: exception: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:12 user devstack@n-api.service[61909]: action_args: {'server_id': '7831232f-c75e-4403-919d-bc2d69b659e5'} Apr 11 20:38:12 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:12 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Returning 404 to user: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-c3cd5089-f185-4f0e-b612-cc382d322552 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036179 Apr 11 20:38:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:12 2023] GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-deleted", "tag": "c8d0aab1-4380-41a7-aeb6-3222168c5c52"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-deleted", "tag": "2279246f-00a6-4589-b12c-ca5ab19d54a7"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-deleted", "tag": "e31567ff-e573-4ed5-a006-bd58e4910906"}, {"server_uuid": "531a0692-eac9-4ac7-95dd-abb138512f30", "name": "network-vif-deleted", "tag": "532c5436-45ba-4503-a774-4fa206ce6f73"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Creating event network-vif-deleted:c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Creating event network-vif-deleted:2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Creating event network-vif-deleted:e31567ff-e573-4ed5-a006-bd58e4910906 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] Creating event network-vif-deleted:532c5436-45ba-4503-a774-4fa206ce6f73 for instance 531a0692-eac9-4ac7-95dd-abb138512f30 on user Apr 11 20:38:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.036969 Apr 11 20:38:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 65/193] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a59e4647-34cf-4e5e-9241-7a542e3c706e tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056623 Apr 11 20:38:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:12 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-1232b440-d07d-4429-938c-db9e988c6e05 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Apr 11 20:38:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 65/195] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:12 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'services' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:38:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments/54c1df9d-22e1-4a3b-a9f9-8200f8463170" status: 202 len: 0 microversion: 2.1 time: 0.293387 Apr 11 20:38:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:38:12 2023] DELETE /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments/54c1df9d-22e1-4a3b-a9f9-8200f8463170 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:12 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-471b20a0-5c70-42ab-a7c2-1360c6c40c33 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Apr 11 20:38:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:12 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] HTTP exception thrown: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Request method failure captured: Apr 11 20:38:13 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 HTTP/1.1 Apr 11 20:38:13 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:38:13 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:38:13 user devstack@n-api.service[61909]: Connection: close Apr 11 20:38:13 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:38:13 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:38:13 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:38:13 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:38:13 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSFDx5trYECo8OdVTl3caiFNHlArm-lIBcHvbDXVzOg_I8lczXiP4y7QgHX19qWoUsxmaFlZ2fXhnNRawsHYnGNEax9Y1DXheNNQKIMvqzcfSy8GnahEeSs442Si6j3Q8yAout8OjZfrats2xsiQoH-0hBqJUC9gXKpSq-DJN237tc Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Project-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Project-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Tenant: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Tenant-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:13 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:13 user devstack@n-api.service[61909]: X-User: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:13 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:38:13 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:38:13 user devstack@n-api.service[61909]: X-User-Id: febd86b9e597436dae2b8c702aff1e8e Apr 11 20:38:13 user devstack@n-api.service[61909]: X-User-Name: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:13 user devstack@n-api.service[61909]: method: > Apr 11 20:38:13 user devstack@n-api.service[61909]: exception: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61909]: action_args: {'id': '7831232f-c75e-4403-919d-bc2d69b659e5'} Apr 11 20:38:13 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Returning 404 to user: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-85f9025d-e38f-4d74-b1dd-d29d8ebdf11e tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 404 len: 111 microversion: 2.1 time: 0.031235 Apr 11 20:38:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 66/198] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:38:13 2023] DELETE /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:13 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] HTTP exception thrown: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Request method failure captured: Apr 11 20:38:13 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 HTTP/1.1 Apr 11 20:38:13 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:38:13 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:38:13 user devstack@n-api.service[61907]: Connection: close Apr 11 20:38:13 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:38:13 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:38:13 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:38:13 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:38:13 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSFDx5trYECo8OdVTl3caiFNHlArm-lIBcHvbDXVzOg_I8lczXiP4y7QgHX19qWoUsxmaFlZ2fXhnNRawsHYnGNEax9Y1DXheNNQKIMvqzcfSy8GnahEeSs442Si6j3Q8yAout8OjZfrats2xsiQoH-0hBqJUC9gXKpSq-DJN237tc Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Project-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Project-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0987ef9e9d6848ce9936af3567da53a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Tenant: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Tenant-Id: 0987ef9e9d6848ce9936af3567da53a2 Apr 11 20:38:13 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287076322 Apr 11 20:38:13 user devstack@n-api.service[61907]: X-User: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:13 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:38:13 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:38:13 user devstack@n-api.service[61907]: X-User-Id: febd86b9e597436dae2b8c702aff1e8e Apr 11 20:38:13 user devstack@n-api.service[61907]: X-User-Name: tempest-DeleteServersTestJSON-1287076322-project-member Apr 11 20:38:13 user devstack@n-api.service[61907]: method: > Apr 11 20:38:13 user devstack@n-api.service[61907]: exception: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61907]: action_args: {'id': '7831232f-c75e-4403-919d-bc2d69b659e5'} Apr 11 20:38:13 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. Apr 11 20:38:13 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Returning 404 to user: Instance 7831232f-c75e-4403-919d-bc2d69b659e5 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:13 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-fe3932ec-99cf-4e9d-8499-d5d568e674d0 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5" status: 404 len: 111 microversion: 2.1 time: 0.043515 Apr 11 20:38:13 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:13 2023] GET /compute/v2.1/servers/7831232f-c75e-4403-919d-bc2d69b659e5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d975fa68-d021-431a-8032-7d33c20d9be0 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '.version_select at 0x7f7268844670>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d975fa68-d021-431a-8032-7d33c20d9be0 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb" status: 200 len: 1723 microversion: 2.1 time: 0.059557 Apr 11 20:38:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 20:38:17 2023] GET /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb => generated 1723 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:17 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-905955fb-2df5-4c78-9b0e-66b6a765cd6a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '.version_select at 0x7f72686637f0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-905955fb-2df5-4c78-9b0e-66b6a765cd6a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb" status: 200 len: 1723 microversion: 2.1 time: 0.053835 Apr 11 20:38:17 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 20:38:17 2023] GET /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb => generated 1723 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=36 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:17 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d0517fbf-70ab-4e62-a200-6a797395ce6c tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1671 microversion: 2.1 time: 0.160092 Apr 11 20:38:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:17 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=5 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-be9870df-07b2-43f6-a51a-8c137ccc1bfd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055347 Apr 11 20:38:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:38:41 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:38:41 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-566404294", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "f8c05312-c164-4467-85c1-b6d6a33e43db"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:41 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=27 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:41 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=76,nova_cell1:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:41 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] validate_networks() for [('f8c05312-c164-4467-85c1-b6d6a33e43db', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting quotas for project 0ab02b2eef8d40f18b755b63d2a14c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting quotas for user af25924dd6564739a52fd957edceb143 and project 0ab02b2eef8d40f18b755b63d2a14c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:38:42 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:38:42 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.574826 Apr 11 20:38:42 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 68/204] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:38:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:38:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b0ab7b5a-85b4-44ed-a2aa-99b4ca6d1efd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b0ab7b5a-85b4-44ed-a2aa-99b4ca6d1efd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:42 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:42 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=5 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b0ab7b5a-85b4-44ed-a2aa-99b4ca6d1efd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b0ab7b5a-85b4-44ed-a2aa-99b4ca6d1efd tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4" status: 200 len: 1211 microversion: 2.1 time: 0.073309 Apr 11 20:38:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 69/205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:42 2023] GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => generated 1211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b8fa17-6b3b-42ea-84ee-06a9beca49b4", "tag": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Creating event network-changed:c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 on user Apr 11 20:38:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029794 Apr 11 20:38:45 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 69/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b8fa17-6b3b-42ea-84ee-06a9beca49b4", "name": "network-vif-plugged", "status": "completed", "tag": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Creating event network-vif-plugged:c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 on user Apr 11 20:38:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049299 Apr 11 20:38:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b8fa17-6b3b-42ea-84ee-06a9beca49b4", "name": "network-vif-plugged", "status": "completed", "tag": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Creating event network-vif-plugged:c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 on user Apr 11 20:38:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040355 Apr 11 20:38:49 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:53 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] HTTP exception thrown: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Request method failure captured: Apr 11 20:38:53 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 HTTP/1.1 Apr 11 20:38:53 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:38:53 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:38:53 user devstack@n-api.service[61908]: Connection: close Apr 11 20:38:53 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:38:53 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:38:53 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:38:53 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:38:53 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSI38MElLJA5A5Gb-WV3HSaTPnv9dsnTeGVKu01-o1-sxsrcNlCbsKEbS0wgV1eMG5rJYR3re1zi3oEIW5iML5LalbwLRXBgQbFlvGY6cP8dPX6aoQnuHB3nDX-OtjOqaGAGktcsZikkleFUeegltwevnX2--Bux9g8TYTxyRD8RXg Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Project-Id: 284929c90a1e41559d5aa3885cd928b4 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Tenant-Id: 284929c90a1e41559d5aa3885cd928b4 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-User: tempest-AttachSCSIVolumeTestJSON-1026499087-project-member Apr 11 20:38:53 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:38:53 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:38:53 user devstack@n-api.service[61908]: X-User-Id: 77a83734398b4ac6bb576381f2557f76 Apr 11 20:38:53 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1026499087-project-member Apr 11 20:38:53 user devstack@n-api.service[61908]: method: > Apr 11 20:38:53 user devstack@n-api.service[61908]: exception: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:53 user devstack@n-api.service[61908]: action_args: {'id': '674a4347-8da2-4455-8e90-0fd358b5f696'} Apr 11 20:38:53 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:53 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:38:53 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Returning 404 to user: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:53 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-18877cd4-f250-451e-94a1-58bf9f83b94d tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 404 len: 111 microversion: 2.1 time: 0.029347 Apr 11 20:38:53 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:53 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:53 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:53 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-02b004c6-dd2f-4ea2-98e1-223ffabf06f8 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '.version_select at 0x7f72686c0700>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-02b004c6-dd2f-4ea2-98e1-223ffabf06f8 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-790069645" status: 202 len: 0 microversion: 2.1 time: 0.033596 Apr 11 20:38:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:38:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-790069645 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] HTTP exception thrown: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Request method failure captured: Apr 11 20:38:54 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 HTTP/1.1 Apr 11 20:38:54 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:38:54 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:38:54 user devstack@n-api.service[61907]: Connection: close Apr 11 20:38:54 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:38:54 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:38:54 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:38:54 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:38:54 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSNENxILJ0pPrSmVpr1b778eKyN_sNVdXZjEtiy_WxPAFtSWjvS1e77-YfqylUCugjlpP0goIJOvq2Sofl9X3bPo8VPvMb9vEcRtHnxmYK4mf6bvoP0Jjxh7PrYNyDBE8uCFtzKepFTEupnCPts0cpF6Zn6TfoW0IyRblFx7pcFH1U Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Project-Id: caa968f4c38c40719e6169250097c718 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Project-Name: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa968f4c38c40719e6169250097c718"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa968f4c38c40719e6169250097c718"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/caa968f4c38c40719e6169250097c718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Tenant: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Tenant-Id: caa968f4c38c40719e6169250097c718 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:54 user devstack@n-api.service[61907]: X-User: tempest-TaggedBootDevicesTest-1812283911-project-member Apr 11 20:38:54 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:38:54 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:38:54 user devstack@n-api.service[61907]: X-User-Id: d5d98b3ceee842b08adb37e62e68436e Apr 11 20:38:54 user devstack@n-api.service[61907]: X-User-Name: tempest-TaggedBootDevicesTest-1812283911-project-member Apr 11 20:38:54 user devstack@n-api.service[61907]: method: > Apr 11 20:38:54 user devstack@n-api.service[61907]: exception: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:54 user devstack@n-api.service[61907]: action_args: {'id': '531a0692-eac9-4ac7-95dd-abb138512f30'} Apr 11 20:38:54 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:54 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Returning 404 to user: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-2f679c92-023e-40e2-b3b9-cf6f60feb8ca tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 404 len: 111 microversion: 2.32 time: 0.034884 Apr 11 20:38:54 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 71/211] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:38:54 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:38:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-856eeff5-1ecf-411a-b796-c61f1bc89d5e tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '.version_select at 0x7f72688449d0>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-856eeff5-1ecf-411a-b796-c61f1bc89d5e tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312085823" status: 204 len: 0 microversion: 2.32 time: 0.021453 Apr 11 20:38:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 20:38:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312085823 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-530533b2-3d9b-444e-899a-c1b856ac3261 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-instance-actions/req-4dfefc93-9c79-463d-8465-f727997d2a94" status: 200 len: 503 microversion: 2.49 time: 0.079864 Apr 11 20:38:56 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 71/213] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 20:38:56 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-instance-actions/req-4dfefc93-9c79-463d-8465-f727997d2a94 => generated 503 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-4074feb3-b517-477e-b06d-ab9fc288b841 tempest-TaggedAttachmentsTest-2035939736 tempest-TaggedAttachmentsTest-2035939736-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-instance-actions/req-4dfefc93-9c79-463d-8465-f727997d2a94" status: 200 len: 503 microversion: 2.49 time: 0.118070 Apr 11 20:38:56 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 72/214] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 20:38:56 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-instance-actions/req-4dfefc93-9c79-463d-8465-f727997d2a94 => generated 503 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8f9e78c3-609a-46b3-bce9-9bc71a302e4e tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.056777 Apr 11 20:38:56 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 72/215] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 20:38:56 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:38:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 204 len: 0 microversion: 2.49 time: 0.180153 Apr 11 20:38:56 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 72/216] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:38:56 2023] DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:56 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:38:56 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-2fb8001e-bffa-40c9-87cc-066e94db3429 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 200 len: 1751 microversion: 2.49 time: 0.330928 Apr 11 20:38:56 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 73/217] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:38:56 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 1751 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:38:56 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-unplugged", "status": "completed", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Creating event network-vif-unplugged:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:38:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033762 Apr 11 20:38:57 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 73/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] HTTP exception thrown: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Request method failure captured: Apr 11 20:38:57 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 HTTP/1.1 Apr 11 20:38:57 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:38:57 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:38:57 user devstack@n-api.service[61909]: Connection: close Apr 11 20:38:57 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:38:57 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:38:57 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:38:57 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:38:57 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSI38MElLJA5A5Gb-WV3HSaTPnv9dsnTeGVKu01-o1-sxsrcNlCbsKEbS0wgV1eMG5rJYR3re1zi3oEIW5iML5LalbwLRXBgQbFlvGY6cP8dPX6aoQnuHB3nDX-OtjOqaGAGktcsZikkleFUeegltwevnX2--Bux9g8TYTxyRD8RXg Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Project-Id: 284929c90a1e41559d5aa3885cd928b4 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Tenant-Id: 284929c90a1e41559d5aa3885cd928b4 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-User: tempest-AttachSCSIVolumeTestJSON-1026499087-project-member Apr 11 20:38:57 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:38:57 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:38:57 user devstack@n-api.service[61909]: X-User-Id: 77a83734398b4ac6bb576381f2557f76 Apr 11 20:38:57 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1026499087-project-member Apr 11 20:38:57 user devstack@n-api.service[61909]: method: > Apr 11 20:38:57 user devstack@n-api.service[61909]: exception: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61909]: action_args: {'id': '674a4347-8da2-4455-8e90-0fd358b5f696'} Apr 11 20:38:57 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Returning 404 to user: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e9d9d412-d168-4881-bdc3-8d58fe00f880 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 404 len: 111 microversion: 2.1 time: 0.034958 Apr 11 20:38:57 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:38:57 2023] DELETE /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] HTTP exception thrown: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Request method failure captured: Apr 11 20:38:57 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 HTTP/1.1 Apr 11 20:38:57 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:38:57 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:38:57 user devstack@n-api.service[61907]: Connection: close Apr 11 20:38:57 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:38:57 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:38:57 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:38:57 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:38:57 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSI38MElLJA5A5Gb-WV3HSaTPnv9dsnTeGVKu01-o1-sxsrcNlCbsKEbS0wgV1eMG5rJYR3re1zi3oEIW5iML5LalbwLRXBgQbFlvGY6cP8dPX6aoQnuHB3nDX-OtjOqaGAGktcsZikkleFUeegltwevnX2--Bux9g8TYTxyRD8RXg Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Project-Id: 284929c90a1e41559d5aa3885cd928b4 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/284929c90a1e41559d5aa3885cd928b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Tenant-Id: 284929c90a1e41559d5aa3885cd928b4 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1026499087 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-User: tempest-AttachSCSIVolumeTestJSON-1026499087-project-member Apr 11 20:38:57 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:38:57 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:38:57 user devstack@n-api.service[61907]: X-User-Id: 77a83734398b4ac6bb576381f2557f76 Apr 11 20:38:57 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1026499087-project-member Apr 11 20:38:57 user devstack@n-api.service[61907]: method: > Apr 11 20:38:57 user devstack@n-api.service[61907]: exception: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61907]: action_args: {'id': '674a4347-8da2-4455-8e90-0fd358b5f696'} Apr 11 20:38:57 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. Apr 11 20:38:57 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:57 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Returning 404 to user: Instance 674a4347-8da2-4455-8e90-0fd358b5f696 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6980646e-506f-4233-ac45-485d6f811e11 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696" status: 404 len: 111 microversion: 2.1 time: 0.030233 Apr 11 20:38:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 74/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:38:57 2023] GET /compute/v2.1/servers/674a4347-8da2-4455-8e90-0fd358b5f696 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:38:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-plugged", "status": "completed", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}, {"server_uuid": "b7d2dbd0-544c-4146-b35c-125eef81c281", "name": "network-vif-deleted", "tag": "81fa518b-09cd-4072-b9be-2f74d2453d76"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:38:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Creating event network-vif-plugged:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:38:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Creating event network-vif-deleted:81fa518b-09cd-4072-b9be-2f74d2453d76 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 on user Apr 11 20:38:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035559 Apr 11 20:38:59 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:38:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] HTTP exception thrown: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Request method failure captured: Apr 11 20:38:59 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 HTTP/1.1 Apr 11 20:38:59 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:38:59 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:38:59 user devstack@n-api.service[61909]: Connection: close Apr 11 20:38:59 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:38:59 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:38:59 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:38:59 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:38:59 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSNENxILJ0pPrSmVpr1b778eKyN_sNVdXZjEtiy_WxPAFtSWjvS1e77-YfqylUCugjlpP0goIJOvq2Sofl9X3bPo8VPvMb9vEcRtHnxmYK4mf6bvoP0Jjxh7PrYNyDBE8uCFtzKepFTEupnCPts0cpF6Zn6TfoW0IyRblFx7pcFH1U Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Project-Id: caa968f4c38c40719e6169250097c718 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Project-Name: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa968f4c38c40719e6169250097c718"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa968f4c38c40719e6169250097c718"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/caa968f4c38c40719e6169250097c718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Tenant: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Tenant-Id: caa968f4c38c40719e6169250097c718 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:59 user devstack@n-api.service[61909]: X-User: tempest-TaggedBootDevicesTest-1812283911-project-member Apr 11 20:38:59 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:38:59 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:38:59 user devstack@n-api.service[61909]: X-User-Id: d5d98b3ceee842b08adb37e62e68436e Apr 11 20:38:59 user devstack@n-api.service[61909]: X-User-Name: tempest-TaggedBootDevicesTest-1812283911-project-member Apr 11 20:38:59 user devstack@n-api.service[61909]: method: > Apr 11 20:38:59 user devstack@n-api.service[61909]: exception: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61909]: action_args: {'id': '531a0692-eac9-4ac7-95dd-abb138512f30'} Apr 11 20:38:59 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Returning 404 to user: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-81fbaba1-1840-4142-86de-12f7ab52d777 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 404 len: 111 microversion: 2.32 time: 0.039824 Apr 11 20:38:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 74/222] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:38:59 2023] DELETE /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:38:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] HTTP exception thrown: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Request method failure captured: Apr 11 20:38:59 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 HTTP/1.1 Apr 11 20:38:59 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:38:59 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:38:59 user devstack@n-api.service[61907]: Connection: close Apr 11 20:38:59 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:38:59 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:38:59 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:38:59 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:38:59 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSNENxILJ0pPrSmVpr1b778eKyN_sNVdXZjEtiy_WxPAFtSWjvS1e77-YfqylUCugjlpP0goIJOvq2Sofl9X3bPo8VPvMb9vEcRtHnxmYK4mf6bvoP0Jjxh7PrYNyDBE8uCFtzKepFTEupnCPts0cpF6Zn6TfoW0IyRblFx7pcFH1U Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Project-Id: caa968f4c38c40719e6169250097c718 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Project-Name: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa968f4c38c40719e6169250097c718"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa968f4c38c40719e6169250097c718"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/caa968f4c38c40719e6169250097c718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Tenant: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Tenant-Id: caa968f4c38c40719e6169250097c718 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1812283911 Apr 11 20:38:59 user devstack@n-api.service[61907]: X-User: tempest-TaggedBootDevicesTest-1812283911-project-member Apr 11 20:38:59 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:38:59 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:38:59 user devstack@n-api.service[61907]: X-User-Id: d5d98b3ceee842b08adb37e62e68436e Apr 11 20:38:59 user devstack@n-api.service[61907]: X-User-Name: tempest-TaggedBootDevicesTest-1812283911-project-member Apr 11 20:38:59 user devstack@n-api.service[61907]: method: > Apr 11 20:38:59 user devstack@n-api.service[61907]: exception: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61907]: action_args: {'id': '531a0692-eac9-4ac7-95dd-abb138512f30'} Apr 11 20:38:59 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. Apr 11 20:38:59 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:38:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Returning 404 to user: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:38:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-16cd7ac2-7150-4317-a1cc-771280b9c546 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30" status: 404 len: 111 microversion: 2.32 time: 0.033139 Apr 11 20:38:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 75/223] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:38:59 2023] GET /compute/v2.1/servers/531a0692-eac9-4ac7-95dd-abb138512f30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3bc64dd4-35f0-429e-b3c5-fd6d49c6e55f tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081526 Apr 11 20:39:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 75/224] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:39:02 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:02 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:39:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934" status: 204 len: 0 microversion: 2.1 time: 0.142608 Apr 11 20:39:02 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:39:02 2023] DELETE /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "name": "network-vif-unplugged", "status": "completed", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:03 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f180b6f746141ae9e52234fd8804b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a37d13cdd4a8f90c4cd205d4f8b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-950ecac0-d38c-4929-bc51-c1c64ee1d076 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934" status: 200 len: 1648 microversion: 2.1 time: 0.404827 Apr 11 20:39:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:02 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934 => generated 1648 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Creating event network-vif-unplugged:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:39:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049061 Apr 11 20:39:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 76/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "name": "network-vif-plugged", "status": "completed", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}, {"server_uuid": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "name": "network-vif-deleted", "tag": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Creating event network-vif-plugged:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:39:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Creating event network-vif-deleted:4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 on user Apr 11 20:39:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034266 Apr 11 20:39:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 76/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-11dffe61-285c-443c-9d4f-55814b007eaf tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'create', calling method: .version_select at 0x7f7268666320>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-338876043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:10 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-11dffe61-285c-443c-9d4f-55814b007eaf tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for project cdd62a4c803247588716e71c25c62b05. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:39:10 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-11dffe61-285c-443c-9d4f-55814b007eaf tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for user 0a70ed7ce13442e6b7f6f62b960520ad and project cdd62a4c803247588716e71c25c62b05. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:39:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-11dffe61-285c-443c-9d4f-55814b007eaf tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.147493 Apr 11 20:39:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 77/229] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:39:10 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1961006747", "imageRef": "34247816-448f-4660-9d3b-31800b7e69d9", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-338876043", "networks": [{"uuid": "015d6542-ba34-4e59-8cbe-3f538cd1f769"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] validate_networks() for [('015d6542-ba34-4e59-8cbe-3f538cd1f769', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for project cdd62a4c803247588716e71c25c62b05. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for user 0a70ed7ce13442e6b7f6f62b960520ad and project cdd62a4c803247588716e71c25c62b05. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:39:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='34247816-448f-4660-9d3b-31800b7e69d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:39:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.540020 Apr 11 20:39:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 77/230] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:39:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:39:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-03259fa3-3424-4b72-baf2-3ac742f2b2f0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-03259fa3-3424-4b72-baf2-3ac742f2b2f0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:11 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-03259fa3-3424-4b72-baf2-3ac742f2b2f0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-03259fa3-3424-4b72-baf2-3ac742f2b2f0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1252 microversion: 2.1 time: 0.096228 Apr 11 20:39:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 77/231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:10 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac687e43-f85e-48a9-bbbe-69afaba2ec38"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-18b8d271-2488-4797-9b16-869e9083867d tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.392248 Apr 11 20:39:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 78/232] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 20:39:11 2023] POST /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments => generated 188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=31 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61908) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/action" status: 202 len: 0 microversion: 2.20 time: 0.235593 Apr 11 20:39:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 78/233] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:39:12 2023] POST /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:12 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e93f1cce-4b04-45ad-b7c1-79e08070fa35 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1657 microversion: 2.1 time: 0.307803 Apr 11 20:39:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 78/234] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:12 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1657 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9482e06e-2cf5-4af8-b281-e43941df6b7c"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:12 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ef0853dd-7ed7-414e-976d-75c8d22ec881 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1739 microversion: 2.20 time: 0.180006 Apr 11 20:39:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 79/235] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:39:12 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:39:13 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408388 Apr 11 20:39:13 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 79/236] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:39:12 2023] POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Creating event network-changed:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:39:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033161 Apr 11 20:39:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 79/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-plugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Creating event network-vif-plugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:39:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056184 Apr 11 20:39:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:18 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-27a16c38-f3e0-4ff8-96dd-8dd33afac83b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1671 microversion: 2.1 time: 0.195737 Apr 11 20:39:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-plugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:18 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Creating event network-vif-plugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:39:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080796 Apr 11 20:39:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 80/240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b9f6713-befd-4589-bd9a-3defae1c71e7"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:20 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422737 Apr 11 20:39:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 81/241] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:39:20 2023] POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:20 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-2098e0ae-e110-44eb-b06a-053963b8cf7d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1703 microversion: 2.1 time: 0.224414 Apr 11 20:39:20 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:20 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1703 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1788631209", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:21 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: dict_keys(['metadata_items']) {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: dict_keys(['metadata_items']) {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:39:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Creating event network-changed:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:39:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052080 Apr 11 20:39:21 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/action" status: 202 len: 1160 microversion: 2.1 time: 0.677654 Apr 11 20:39:21 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 81/244] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 20:39:20 2023] POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/action => generated 1160 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:21 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-bc879031-cdd4-4bba-ab36-1149a1568d8b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1732 microversion: 2.1 time: 0.248739 Apr 11 20:39:21 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 82/245] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:21 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:22 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-unplugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:22 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Creating event network-vif-unplugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:39:22 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038585 Apr 11 20:39:22 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 83/246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:24 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:24 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:24 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:24 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:24 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:39:24 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044512 Apr 11 20:39:24 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 82/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1906d4ae-83e8-471b-b5db-3d5abb7016eb"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:28 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'flavor' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:39:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/action" status: 200 len: 29 microversion: 2.1 time: 0.291476 Apr 11 20:39:28 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 83/248] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:39:28 2023] POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/action => generated 29 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:29 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ffe13d2a-0358-48e8-abf1-0f75776aa3ec tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1723 microversion: 2.1 time: 0.272130 Apr 11 20:39:29 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:28 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:30 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Creating event network-vif-unplugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:39:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035762 Apr 11 20:39:30 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 83/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}, {"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-plugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}, {"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-plugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:39:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Creating event network-vif-plugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:39:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Creating event network-vif-plugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:39:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065392 Apr 11 20:39:32 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:32 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4846f22f-7fb4-4f53-83d2-b7372860dcb0 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4" status: 200 len: 1493 microversion: 2.1 time: 0.252798 Apr 11 20:39:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 84/252] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:32 2023] GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => generated 1493 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:39:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:39:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058563 Apr 11 20:39:37 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 84/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:37 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:37 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:39:37 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061808 Apr 11 20:39:37 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 86/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:39:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031195 Apr 11 20:39:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 85/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:39:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042030 Apr 11 20:39:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 85/256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:43 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-002464c6-ae33-44f8-b4ad-54d3630221af tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Action: 'create', calling method: .version_select at 0x7f72693cba30>, body: {"keypair": {"name": "tempest-keypair-1724644128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:43 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=16 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:43 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-002464c6-ae33-44f8-b4ad-54d3630221af tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting quotas for project d89f013fadbe411caf0a6f2856a11135. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:39:44 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-002464c6-ae33-44f8-b4ad-54d3630221af tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting quotas for user 928391a137c94107af4dd426b9a086f7 and project d89f013fadbe411caf0a6f2856a11135. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:39:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-002464c6-ae33-44f8-b4ad-54d3630221af tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.120826 Apr 11 20:39:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 87/257] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 20:39:43 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 20:39:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-902658976", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1c29d681-3612-460d-8aaa-35ae068f7ce6"}, {"port": "4af039ce-a832-46f5-9c67-e57a075dec43", "tag": "port-1"}, {"port": "fa937413-1cdc-4426-8707-25d48f79124c", "tag": "port-2"}, {"uuid": "c1513590-dd19-4e86-86a0-1e12264455ec", "tag": "net-1"}, {"uuid": "c1513590-dd19-4e86-86a0-1e12264455ec"}, {"uuid": "340d0912-d68e-427f-9ed9-e63555c56ad8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "340d0912-d68e-427f-9ed9-e63555c56ad8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0b80e2a1-e119-4c40-97c9-7d393ddf700c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "78e8c94c-6902-4769-9266-b990c406ce59", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1039687467"}], "key_name": "tempest-keypair-1724644128", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:45 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:46 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] validate_networks() for [('1c29d681-3612-460d-8aaa-35ae068f7ce6', None, None, None, None, None), (None, None, '4af039ce-a832-46f5-9c67-e57a075dec43', None, None, None), (None, None, 'fa937413-1cdc-4426-8707-25d48f79124c', None, None, None), ('c1513590-dd19-4e86-86a0-1e12264455ec', None, None, None, None, None), ('c1513590-dd19-4e86-86a0-1e12264455ec', None, None, None, None, None), ('340d0912-d68e-427f-9ed9-e63555c56ad8', '10.2.2.100', None, None, None, None), ('340d0912-d68e-427f-9ed9-e63555c56ad8', '10.2.2.200', None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=28 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] HTTP exception thrown: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Request method failure captured: Apr 11 20:39:47 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 HTTP/1.1 Apr 11 20:39:47 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:39:47 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:39:47 user devstack@n-api.service[61909]: Connection: close Apr 11 20:39:47 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:39:47 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:39:47 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:39:47 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:39:47 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSGqW7dxPPxeKzGpb0ZNDLQQlRL9QwudpnXgoCqPL3bfMGYqXvFg7X5WtEc7O1nr17r0bf9l3Uf-TTKRs88pmnL96p5_AkGMeDMEnDikgKg54_d2dc0l10wVN776CNvXWJ5tzx0YmJPc6JgLbhcBkpwlFrKgBa2w65SQLwxq1OTzrg Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Project-Id: d40e31bd9e6e4d5e9cff3e4f2c1cf412 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Project-Name: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Tenant: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Tenant-Id: d40e31bd9e6e4d5e9cff3e4f2c1cf412 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:47 user devstack@n-api.service[61909]: X-User: tempest-TaggedAttachmentsTest-1851174411-project-member Apr 11 20:39:47 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:39:47 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:39:47 user devstack@n-api.service[61909]: X-User-Id: 05684678d0cd4ccea78238d20d561f3f Apr 11 20:39:47 user devstack@n-api.service[61909]: X-User-Name: tempest-TaggedAttachmentsTest-1851174411-project-member Apr 11 20:39:47 user devstack@n-api.service[61909]: method: > Apr 11 20:39:47 user devstack@n-api.service[61909]: exception: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:47 user devstack@n-api.service[61909]: action_args: {'id': 'b7d2dbd0-544c-4146-b35c-125eef81c281'} Apr 11 20:39:47 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:47 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Returning 404 to user: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:39:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-cea2e4f3-aaea-4bf8-b7ab-c277e3a48838 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 404 len: 111 microversion: 2.49 time: 0.050329 Apr 11 20:39:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 86/258] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:39:47 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:39:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-852e9263-285a-49be-a9c4-34987cdaf8de tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '.version_select at 0x7f72686d2d40>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-852e9263-285a-49be-a9c4-34987cdaf8de tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400889989" status: 204 len: 0 microversion: 2.49 time: 0.024433 Apr 11 20:39:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 88/259] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 20:39:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400889989 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:39:47 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:39:47 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:39:47 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:39:47 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:39:47 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting quotas for project d89f013fadbe411caf0a6f2856a11135. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting quotas for user 928391a137c94107af4dd426b9a086f7 and project d89f013fadbe411caf0a6f2856a11135. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:39:48 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0b80e2a1-e119-4c40-97c9-7d393ddf700c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78e8c94c-6902-4769-9266-b990c406ce59',volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.413122 Apr 11 20:39:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 86/260] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 20:39:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 3416 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:39:49 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:39:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e388c8a8-6744-4712-85e8-b1455a3ba848 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:49 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e388c8a8-6744-4712-85e8-b1455a3ba848 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] HTTP exception thrown: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Request method failure captured: Apr 11 20:39:49 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 HTTP/1.1 Apr 11 20:39:49 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:39:49 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:39:49 user devstack@n-api.service[61909]: Connection: close Apr 11 20:39:49 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:39:49 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:39:49 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:39:49 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:39:49 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSGqW7dxPPxeKzGpb0ZNDLQQlRL9QwudpnXgoCqPL3bfMGYqXvFg7X5WtEc7O1nr17r0bf9l3Uf-TTKRs88pmnL96p5_AkGMeDMEnDikgKg54_d2dc0l10wVN776CNvXWJ5tzx0YmJPc6JgLbhcBkpwlFrKgBa2w65SQLwxq1OTzrg Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Project-Id: d40e31bd9e6e4d5e9cff3e4f2c1cf412 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Project-Name: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Tenant: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Tenant-Id: d40e31bd9e6e4d5e9cff3e4f2c1cf412 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:49 user devstack@n-api.service[61909]: X-User: tempest-TaggedAttachmentsTest-1851174411-project-member Apr 11 20:39:49 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:39:49 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:39:49 user devstack@n-api.service[61909]: X-User-Id: 05684678d0cd4ccea78238d20d561f3f Apr 11 20:39:49 user devstack@n-api.service[61909]: X-User-Name: tempest-TaggedAttachmentsTest-1851174411-project-member Apr 11 20:39:49 user devstack@n-api.service[61909]: method: > Apr 11 20:39:49 user devstack@n-api.service[61909]: exception: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61909]: action_args: {'id': 'b7d2dbd0-544c-4146-b35c-125eef81c281'} Apr 11 20:39:49 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Returning 404 to user: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:39:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5d1aa373-2253-4f64-8a93-7e254f4e784f tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 404 len: 111 microversion: 2.49 time: 0.052343 Apr 11 20:39:49 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 87/261] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:39:49 2023] DELETE /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:49 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e388c8a8-6744-4712-85e8-b1455a3ba848 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:49 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e388c8a8-6744-4712-85e8-b1455a3ba848 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:49 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e388c8a8-6744-4712-85e8-b1455a3ba848 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:39:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] HTTP exception thrown: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e388c8a8-6744-4712-85e8-b1455a3ba848 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 200 len: 1279 microversion: 2.42 time: 0.090661 Apr 11 20:39:49 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 89/262] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:39:49 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Request method failure captured: Apr 11 20:39:49 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 HTTP/1.1 Apr 11 20:39:49 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:39:49 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:39:49 user devstack@n-api.service[61908]: Connection: close Apr 11 20:39:49 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:39:49 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:39:49 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:39:49 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:39:49 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSGqW7dxPPxeKzGpb0ZNDLQQlRL9QwudpnXgoCqPL3bfMGYqXvFg7X5WtEc7O1nr17r0bf9l3Uf-TTKRs88pmnL96p5_AkGMeDMEnDikgKg54_d2dc0l10wVN776CNvXWJ5tzx0YmJPc6JgLbhcBkpwlFrKgBa2w65SQLwxq1OTzrg Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Project-Id: d40e31bd9e6e4d5e9cff3e4f2c1cf412 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Project-Name: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d40e31bd9e6e4d5e9cff3e4f2c1cf412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Tenant: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Tenant-Id: d40e31bd9e6e4d5e9cff3e4f2c1cf412 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1851174411 Apr 11 20:39:49 user devstack@n-api.service[61908]: X-User: tempest-TaggedAttachmentsTest-1851174411-project-member Apr 11 20:39:49 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:39:49 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:39:49 user devstack@n-api.service[61908]: X-User-Id: 05684678d0cd4ccea78238d20d561f3f Apr 11 20:39:49 user devstack@n-api.service[61908]: X-User-Name: tempest-TaggedAttachmentsTest-1851174411-project-member Apr 11 20:39:49 user devstack@n-api.service[61908]: method: > Apr 11 20:39:49 user devstack@n-api.service[61908]: exception: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61908]: action_args: {'id': 'b7d2dbd0-544c-4146-b35c-125eef81c281'} Apr 11 20:39:49 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. Apr 11 20:39:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:39:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Returning 404 to user: Instance b7d2dbd0-544c-4146-b35c-125eef81c281 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:39:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5a2eaaec-24b3-43a5-895f-086178dd533d tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281" status: 404 len: 111 microversion: 2.49 time: 0.079350 Apr 11 20:39:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 87/263] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:39:49 2023] GET /compute/v2.1/servers/b7d2dbd0-544c-4146-b35c-125eef81c281 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] HTTP exception thrown: Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 could not be found. Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Request method failure captured: Apr 11 20:39:53 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934 HTTP/1.1 Apr 11 20:39:53 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:39:53 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:39:53 user devstack@n-api.service[61909]: Connection: close Apr 11 20:39:53 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:39:53 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:39:53 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:39:53 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:39:53 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcR_GSNeD5oOZdI8DK1Sgz2PSynA1By8BIqtsKUkaBkCpI04rtfUmnzzyc6q5c3Tb1YPpUQ2h_EAqsnmFOhsyVLhd2sxGzdcKxaqiCz33rvPZyvC8slzmZQ5oDFGvhVKBB3UWFc-4f8bdcxoLxpfvI1KSgI3J1tVqn1kNQyXnxUVj8Q Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Project-Id: 2f2a37d13cdd4a8f90c4cd205d4f8b76 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Project-Name: tempest-TestVolumeSwap-384933576 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f2a37d13cdd4a8f90c4cd205d4f8b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f2a37d13cdd4a8f90c4cd205d4f8b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f2a37d13cdd4a8f90c4cd205d4f8b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Tenant: tempest-TestVolumeSwap-384933576 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Tenant-Id: 2f2a37d13cdd4a8f90c4cd205d4f8b76 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TestVolumeSwap-384933576 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-User: tempest-TestVolumeSwap-384933576-project-member Apr 11 20:39:53 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:39:53 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:39:53 user devstack@n-api.service[61909]: X-User-Id: 8f180b6f746141ae9e52234fd8804b29 Apr 11 20:39:53 user devstack@n-api.service[61909]: X-User-Name: tempest-TestVolumeSwap-384933576-project-member Apr 11 20:39:53 user devstack@n-api.service[61909]: method: > Apr 11 20:39:53 user devstack@n-api.service[61909]: exception: Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 could not be found. Apr 11 20:39:53 user devstack@n-api.service[61909]: action_args: {'id': 'cafd98ea-fe9e-4159-a454-6833bdcb8934'} Apr 11 20:39:53 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 could not be found. Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 could not be found. Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 could not be found. Apr 11 20:39:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:39:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Returning 404 to user: Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:39:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-3ac24006-18f8-4aa8-a808-b815e92a271c tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934" status: 404 len: 111 microversion: 2.1 time: 0.084659 Apr 11 20:39:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:39:53 2023] GET /compute/v2.1/servers/cafd98ea-fe9e-4159-a454-6833bdcb8934 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:39:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c601085a-dbc8-4c37-a087-1136f7528c38 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Calling method '.version_select at 0x7f72686d1900>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:39:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c601085a-dbc8-4c37-a087-1136f7528c38 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208847137" status: 202 len: 0 microversion: 2.1 time: 0.024091 Apr 11 20:39:53 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 90/265] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:39:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208847137 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:39:57 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Creating event network-changed:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:39:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051633 Apr 11 20:39:57 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:39:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "4af039ce-a832-46f5-9c67-e57a075dec43"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:39:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:39:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:39:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:39:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Creating event network-changed:4af039ce-a832-46f5-9c67-e57a075dec43 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:39:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Apr 11 20:39:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 89/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:39:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:01 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:01 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "fa937413-1cdc-4426-8707-25d48f79124c"}, {"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Creating event network-changed:fa937413-1cdc-4426-8707-25d48f79124c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Creating event network-changed:6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035607 Apr 11 20:40:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 89/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:01 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:01 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-332c9621-fc10-40b2-9c50-b7d8f7233cb1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1534 microversion: 2.1 time: 0.466125 Apr 11 20:40:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:40:01 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1534 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:03 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:03 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:03 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e6254276-2dcf-4f21-b00e-b2e7b7e4e47b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1784 microversion: 2.20 time: 0.428116 Apr 11 20:40:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 90/270] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:40:02 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1784 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:40:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "1380e6a6-4036-442f-8120-243f80c0e646"}, {"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "c20d2e13-a748-4cdd-9ba0-5350f331d56b"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Creating event network-changed:1380e6a6-4036-442f-8120-243f80c0e646 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Creating event network-changed:c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.028357 Apr 11 20:40:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 90/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "030dae9d-cc5b-4278-935b-b032bf6d29dd"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Creating event network-changed:030dae9d-cc5b-4278-935b-b032bf6d29dd for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Apr 11 20:40:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-44480822", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:10 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] validate_networks() for [('6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for user 1d5cb62cc3844248be2e4456d970ccdf and project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:40:11 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:40:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.775292 Apr 11 20:40:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 91/273] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:40:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:40:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-229a3de1-b96c-4e88-8b98-cec8cb649e7a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:11 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-229a3de1-b96c-4e88-8b98-cec8cb649e7a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:11 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-229a3de1-b96c-4e88-8b98-cec8cb649e7a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:11 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-229a3de1-b96c-4e88-8b98-cec8cb649e7a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:11 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-229a3de1-b96c-4e88-8b98-cec8cb649e7a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-229a3de1-b96c-4e88-8b98-cec8cb649e7a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79" status: 200 len: 1393 microversion: 2.87 time: 0.088529 Apr 11 20:40:11 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 91/274] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:40:11 2023] GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 => generated 1393 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:12 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ca9a5724-a326-4951-9502-053415ab0f03 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1723 microversion: 2.1 time: 0.157536 Apr 11 20:40:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 93/275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:40:11 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:40:14 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d5f91c-afaa-456a-97e7-0460b1748d79", "tag": "29039955-eab6-420c-aa2c-dbd6326814c4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Creating event network-changed:29039955-eab6-420c-aa2c-dbd6326814c4 for instance f1d5f91c-afaa-456a-97e7-0460b1748d79 on user Apr 11 20:40:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Apr 11 20:40:14 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 92/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:15 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=9 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Creating event network-vif-plugged:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041996 Apr 11 20:40:15 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 92/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "4af039ce-a832-46f5-9c67-e57a075dec43"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Creating event network-vif-plugged:4af039ce-a832-46f5-9c67-e57a075dec43 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059079 Apr 11 20:40:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 94/278] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:17 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:17 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Creating event network-vif-plugged:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044090 Apr 11 20:40:17 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 93/279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4a53d984-7e14-4f27-aede-10e6017610b8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: .version_select at 0x7f72687e9630>, body: {"keypair": {"name": "tempest-keypair-641505706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:17 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-4a53d984-7e14-4f27-aede-10e6017610b8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:40:17 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-4a53d984-7e14-4f27-aede-10e6017610b8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for user 3c9f583cc98040bc822e1ac7e418aa98 and project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:40:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4a53d984-7e14-4f27-aede-10e6017610b8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263035 Apr 11 20:40:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 93/280] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:40:17 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d5f91c-afaa-456a-97e7-0460b1748d79", "name": "network-vif-plugged", "status": "completed", "tag": "29039955-eab6-420c-aa2c-dbd6326814c4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Creating event network-vif-plugged:29039955-eab6-420c-aa2c-dbd6326814c4 for instance f1d5f91c-afaa-456a-97e7-0460b1748d79 on user Apr 11 20:40:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039377 Apr 11 20:40:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 95/281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "4af039ce-a832-46f5-9c67-e57a075dec43"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "fa937413-1cdc-4426-8707-25d48f79124c"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "fa937413-1cdc-4426-8707-25d48f79124c"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "1380e6a6-4036-442f-8120-243f80c0e646"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "1380e6a6-4036-442f-8120-243f80c0e646"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:4af039ce-a832-46f5-9c67-e57a075dec43 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:fa937413-1cdc-4426-8707-25d48f79124c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:fa937413-1cdc-4426-8707-25d48f79124c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:1380e6a6-4036-442f-8120-243f80c0e646 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Creating event network-vif-plugged:1380e6a6-4036-442f-8120-243f80c0e646 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.046293 Apr 11 20:40:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 94/282] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 20:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "c20d2e13-a748-4cdd-9ba0-5350f331d56b"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "c20d2e13-a748-4cdd-9ba0-5350f331d56b"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1899891318", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f87b05c6-655f-40f5-9d5d-73525169adaa"}], "security_groups": [{"name": "tempest-securitygroup--458785059"}], "key_name": "tempest-keypair-641505706", "user_data": "}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Creating event network-vif-plugged:c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Creating event network-vif-plugged:c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040102 Apr 11 20:40:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 96/283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] validate_networks() for [('f87b05c6-655f-40f5-9d5d-73525169adaa', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:40:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f0c0c910-93d7-4697-ac99-f6a5b468c390 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1703 microversion: 2.1 time: 0.310921 Apr 11 20:40:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:40:19 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1703 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d5f91c-afaa-456a-97e7-0460b1748d79", "name": "network-vif-plugged", "status": "completed", "tag": "29039955-eab6-420c-aa2c-dbd6326814c4"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "030dae9d-cc5b-4278-935b-b032bf6d29dd"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "030dae9d-cc5b-4278-935b-b032bf6d29dd"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Creating event network-vif-plugged:29039955-eab6-420c-aa2c-dbd6326814c4 for instance f1d5f91c-afaa-456a-97e7-0460b1748d79 on user Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Creating event network-vif-plugged:030dae9d-cc5b-4278-935b-b032bf6d29dd for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Creating event network-vif-plugged:030dae9d-cc5b-4278-935b-b032bf6d29dd for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=22 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035612 Apr 11 20:40:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 97/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:19 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for user 3c9f583cc98040bc822e1ac7e418aa98 and project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:40:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:40:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.552690 Apr 11 20:40:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 95/286] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:40:19 2023] POST /compute/v2.1/servers => generated 399 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fafaa7e9-cf62-4978-9002-725d698c2476 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-fafaa7e9-cf62-4978-9002-725d698c2476 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:19 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-fafaa7e9-cf62-4978-9002-725d698c2476 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-fafaa7e9-cf62-4978-9002-725d698c2476 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1231 microversion: 2.1 time: 0.062783 Apr 11 20:40:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:40:19 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1231 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:40:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Creating event network-changed:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:40:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049227 Apr 11 20:40:23 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 98/288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:40:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048755 Apr 11 20:40:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:28 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:40:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034936 Apr 11 20:40:28 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=9 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=24 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7587c653-32b8-4179-903f-05f0f6604519"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] HTTP exception thrown: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Request method failure captured: Apr 11 20:40:34 user devstack@n-api.service[61907]: request: PUT /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/os-volume_attachments/9de0f297-2d2d-4488-ace6-8a32a96a9208 HTTP/1.1 Apr 11 20:40:34 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:40:34 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:40:34 user devstack@n-api.service[61907]: Connection: close Apr 11 20:40:34 user devstack@n-api.service[61907]: Content-Length: 74 Apr 11 20:40:34 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:40:34 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:40:34 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:40:34 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSaS3B_ZbCr3PFFytx_Ko3nF4ibMBiGvgudw-mMTlxe8qsR1hBLoMNwRPk7pKAZbK8Qn9rHYzJjMebQvsyQ1-JsREFItl1r1PmsThTSvq-f9i9QVCrRlPlbtnlUGMdUk53t_6PNJsMsfoJd52dvHmAQywZyoQtoMBrxZwIo1FqxMrw Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Project-Id: 26c922add32c42d2aad8f3f6a43e229b Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Project-Name: tempest-VolumesAdminNegativeTest-194988579 Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Role: admin,member,reader Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Roles: admin,member,reader Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26c922add32c42d2aad8f3f6a43e229b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26c922add32c42d2aad8f3f6a43e229b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26c922add32c42d2aad8f3f6a43e229b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Tenant: tempest-VolumesAdminNegativeTest-194988579 Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Tenant-Id: 26c922add32c42d2aad8f3f6a43e229b Apr 11 20:40:34 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-194988579 Apr 11 20:40:34 user devstack@n-api.service[61907]: X-User: tempest-VolumesAdminNegativeTest-194988579-project-admin Apr 11 20:40:34 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:40:34 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:40:34 user devstack@n-api.service[61907]: X-User-Id: 942b82e3a8e14790acc12b7d79f0f1b6 Apr 11 20:40:34 user devstack@n-api.service[61907]: X-User-Name: tempest-VolumesAdminNegativeTest-194988579-project-admin Apr 11 20:40:34 user devstack@n-api.service[61907]: Apr 11 20:40:34 user devstack@n-api.service[61907]: {"volumeAttachment": {"volumeId": "7587c653-32b8-4179-903f-05f0f6604519"}} Apr 11 20:40:34 user devstack@n-api.service[61907]: method: > Apr 11 20:40:34 user devstack@n-api.service[61907]: exception: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. Apr 11 20:40:34 user devstack@n-api.service[61907]: action_args: {'server_id': '44b8fa17-6b3b-42ea-84ee-06a9beca49b4', 'id': '9de0f297-2d2d-4488-ace6-8a32a96a9208', 'body': {'volumeAttachment': {'volumeId': '7587c653-32b8-4179-903f-05f0f6604519'}}} Apr 11 20:40:34 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. (HTTP 404) (Request-ID: req-feb851f1-876a-47f2-bd95-24bd07cb8c93) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. Apr 11 20:40:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:40:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] Returning 404 to user: Volume 9de0f297-2d2d-4488-ace6-8a32a96a9208 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:40:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-86446d57-902e-47d2-b724-e606b5730878 tempest-VolumesAdminNegativeTest-194988579 tempest-VolumesAdminNegativeTest-194988579-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/os-volume_attachments/9de0f297-2d2d-4488-ace6-8a32a96a9208" status: 404 len: 109 microversion: 2.1 time: 0.076014 Apr 11 20:40:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 99/291] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 20:40:34 2023] PUT /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/os-volume_attachments/9de0f297-2d2d-4488-ace6-8a32a96a9208 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:35 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:40:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4" status: 204 len: 0 microversion: 2.1 time: 0.191911 Apr 11 20:40:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 97/292] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:40:35 2023] DELETE /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:36 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-755a1a13-a680-4f87-89ee-98afe40c23d5 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4" status: 200 len: 1499 microversion: 2.1 time: 0.282014 Apr 11 20:40:36 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:40:35 2023] GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => generated 1499 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:40:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b8fa17-6b3b-42ea-84ee-06a9beca49b4", "name": "network-vif-unplugged", "status": "completed", "tag": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Creating event network-vif-unplugged:c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 on user Apr 11 20:40:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031387 Apr 11 20:40:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 100/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:40:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b8fa17-6b3b-42ea-84ee-06a9beca49b4", "name": "network-vif-plugged", "status": "completed", "tag": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59"}, {"server_uuid": "44b8fa17-6b3b-42ea-84ee-06a9beca49b4", "name": "network-vif-deleted", "tag": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:40:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Creating event network-vif-plugged:c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 on user Apr 11 20:40:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Creating event network-vif-deleted:c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 on user Apr 11 20:40:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092067 Apr 11 20:40:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 98/295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:39 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:40:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-46f86773-6208-415a-9c20-7bc7e7ad8de0 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 200 len: 2828 microversion: 2.42 time: 0.284999 Apr 11 20:40:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 98/296] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:40:39 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 2828 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:01 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d0932f8e-a117-4d0b-9f65-3d68dd9cd46c tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1534 microversion: 2.1 time: 0.195070 Apr 11 20:41:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 101/297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:01 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1534 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5a4d3ca5-114a-48d7-99b4-bb09e1299c1e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79" status: 200 len: 1689 microversion: 2.87 time: 0.217344 Apr 11 20:41:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 99/298] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:41:01 2023] GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching by: {'deleted': False, 'project_id': 'cdd62a4c803247588716e71c25c62b05'} {{(pid=61908) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=22 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:02 user devstack@n-api.service[61908]: DEBUG nova.compute.multi_cell_list [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61908) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 20:41:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-71233190-28b0-40aa-ab03-1f90c2e51e52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.192775 Apr 11 20:41:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 99/299] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 20:41:01 2023] GET /compute/v2.1/servers => generated 341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:02 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9851e6d6-5bc0-4625-be9d-b7c5bd8cf238 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1534 microversion: 2.1 time: 0.147439 Apr 11 20:41:02 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 102/300] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:02 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1534 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0b07abe9-f522-43cd-9b2f-d119ca8ffe3a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments/ac687e43-f85e-48a9-bbbe-69afaba2ec38" status: 200 len: 194 microversion: 2.20 time: 0.140207 Apr 11 20:41:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 100/301] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 20:41:03 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments/ac687e43-f85e-48a9-bbbe-69afaba2ec38 => generated 194 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'services' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:41:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments/ac687e43-f85e-48a9-bbbe-69afaba2ec38" status: 202 len: 0 microversion: 2.20 time: 0.186404 Apr 11 20:41:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 100/302] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 20:41:03 2023] DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments/ac687e43-f85e-48a9-bbbe-69afaba2ec38 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a83f066a-e0ba-4150-bf75-062a2e3d47d9 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049312 Apr 11 20:41:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 103/303] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 20:41:03 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f60ce4f-bf85-446c-bc26-6af1cc7dc546"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273248 Apr 11 20:41:04 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 101/304] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:41:03 2023] POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a999742b-494f-4ed7-bcc9-d79b0575985d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1535 microversion: 2.1 time: 0.159966 Apr 11 20:41:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:10 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1535 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:12 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c577af88-6c9a-4194-a9eb-d6f2f06d4587 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1580 microversion: 2.1 time: 0.194803 Apr 11 20:41:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 104/306] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:12 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1580 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:12 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-7289d458-9715-418e-8777-e1272d4fa159 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1723 microversion: 2.1 time: 0.275903 Apr 11 20:41:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 102/307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:12 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:12 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e1703a36-13e6-4e06-b9ca-6a8daca29d38 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1723 microversion: 2.1 time: 0.240952 Apr 11 20:41:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:12 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:14 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Creating event network-changed:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:41:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031708 Apr 11 20:41:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 105/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1536554826"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:15 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:15 user devstack@n-api.service[61909]: INFO nova.network.security_group_api [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Adding security group a4e13d5c-f130-4a98-9aac-b904c03fd15c to port cff9d1b4-18f3-4450-8d38-f230812fb66e Apr 11 20:41:15 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-642b7e49-008e-4a42-bcc2-f325c8d4616b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/action" status: 202 len: 0 microversion: 2.1 time: 0.637129 Apr 11 20:41:15 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 103/310] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:41:15 2023] POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:15 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Creating event network-changed:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:41:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082225 Apr 11 20:41:15 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 103/311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:16 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6267ed12-e318-41a3-926f-2bff1df4a3d7 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1745 microversion: 2.1 time: 0.260373 Apr 11 20:41:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 106/312] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:15 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/action" status: 202 len: 0 microversion: 2.1 time: 0.100152 Apr 11 20:41:17 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 104/313] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:41:17 2023] POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:17 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-79a92e77-e86c-4ec4-bf6b-ce5508e1a870 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1747 microversion: 2.1 time: 0.170272 Apr 11 20:41:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:17 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1747 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-unplugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Creating event network-vif-unplugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:41:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036897 Apr 11 20:41:18 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 107/315] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/action" status: 202 len: 0 microversion: 2.1 time: 0.201153 Apr 11 20:41:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 105/316] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:41:19 2023] POST /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cdcae90d-555e-4087-b2c8-ac19d7968705 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.150732 Apr 11 20:41:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 105/317] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:41:19 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-interface => generated 282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Creating event network-changed:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:41:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098805 Apr 11 20:41:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:20 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-plugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}, {"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}, {"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:20 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:20 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Creating event network-vif-plugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:41:20 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Creating event network-vif-unplugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:41:20 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:41:20 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.044628 Apr 11 20:41:20 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 106/319] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:41:22 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Creating event network-changed:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:41:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050897 Apr 11 20:41:22 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 106/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:41:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089857 Apr 11 20:41:23 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 109/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}, {"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-plugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}, {"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-plugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:41:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Creating event network-vif-plugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:41:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Creating event network-vif-plugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:41:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047837 Apr 11 20:41:25 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 107/322] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:25 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] HTTP exception thrown: Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 could not be found. Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Request method failure captured: Apr 11 20:41:26 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4 HTTP/1.1 Apr 11 20:41:26 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:41:26 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:41:26 user devstack@n-api.service[61908]: Connection: close Apr 11 20:41:26 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:41:26 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:41:26 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:41:26 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:41:26 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSElNImiunRlNFYGpzrauHq3mIscdNGRXPdFsPIZ6JDwok46QZMlArZdu_RbS5t21D6vnHY6FbUbXJjQSj4qvCwMIkEIu7Qor7r8cJ0xW4elxlaq0DcXgSZqC2zl25MW0ptvMJL9t_Jxvhrp-Nthk5IjSIbl8IppmVpJFFMLlcxNU8 Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Project-Id: 0ab02b2eef8d40f18b755b63d2a14c9b Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Project-Name: tempest-VolumesAdminNegativeTest-878898162 Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ab02b2eef8d40f18b755b63d2a14c9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ab02b2eef8d40f18b755b63d2a14c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ab02b2eef8d40f18b755b63d2a14c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Tenant: tempest-VolumesAdminNegativeTest-878898162 Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Tenant-Id: 0ab02b2eef8d40f18b755b63d2a14c9b Apr 11 20:41:26 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-878898162 Apr 11 20:41:26 user devstack@n-api.service[61908]: X-User: tempest-VolumesAdminNegativeTest-878898162-project-member Apr 11 20:41:26 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:41:26 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:41:26 user devstack@n-api.service[61908]: X-User-Id: af25924dd6564739a52fd957edceb143 Apr 11 20:41:26 user devstack@n-api.service[61908]: X-User-Name: tempest-VolumesAdminNegativeTest-878898162-project-member Apr 11 20:41:26 user devstack@n-api.service[61908]: method: > Apr 11 20:41:26 user devstack@n-api.service[61908]: exception: Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 could not be found. Apr 11 20:41:26 user devstack@n-api.service[61908]: action_args: {'id': '44b8fa17-6b3b-42ea-84ee-06a9beca49b4'} Apr 11 20:41:26 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 could not be found. Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 could not be found. Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 could not be found. Apr 11 20:41:26 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:41:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Returning 404 to user: Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:41:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-02d278a5-acce-4aad-bae5-3d321239adcf tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4" status: 404 len: 111 microversion: 2.1 time: 0.134045 Apr 11 20:41:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 107/323] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:26 2023] GET /compute/v2.1/servers/44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:28 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:41:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1" status: 204 len: 0 microversion: 2.1 time: 0.162932 Apr 11 20:41:28 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 110/324] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:41:28 2023] DELETE /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:28 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:28 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d3e85985-b48e-4a59-a8aa-cb6e2e2f580f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1" status: 200 len: 1668 microversion: 2.1 time: 0.229520 Apr 11 20:41:28 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 108/325] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:41:28 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => generated 1668 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:29 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "name": "network-vif-unplugged", "status": "completed", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Creating event network-vif-unplugged:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:41:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034483 Apr 11 20:41:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 108/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:41:31 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "name": "network-vif-plugged", "status": "completed", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}, {"server_uuid": "52b7250e-a85d-4c3f-93e7-ac05ebd13be1", "name": "network-vif-deleted", "tag": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Creating event network-vif-plugged:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:41:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Creating event network-vif-deleted:1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 on user Apr 11 20:41:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038213 Apr 11 20:41:31 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 111/327] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=22 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-c5edefa1-32d9-4be0-ae18-869de361a422 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.155639 Apr 11 20:41:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 109/328] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:41:39 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2/os-interface => generated 1829 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=20 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Creating event network-changed:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037152 Apr 11 20:41:40 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 109/329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:41:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-785da994-6a1c-493b-a331-a4df83f0c8f7 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 200 len: 2828 microversion: 2.42 time: 0.437958 Apr 11 20:41:41 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 112/330] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:41:40 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 2828 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:41 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f62fd917-79e0-4066-8f55-1fc6d5cc091a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.211476 Apr 11 20:41:41 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 110/331] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:41:41 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2/os-interface => generated 1829 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:41:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 204 len: 0 microversion: 2.42 time: 0.119855 Apr 11 20:41:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 110/332] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:41:42 2023] DELETE /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:43 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:43 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:43 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-27a95f50-ec5c-4d63-bc79-8cb9d5a4afeb tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 200 len: 2953 microversion: 2.42 time: 0.230380 Apr 11 20:41:43 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 113/333] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:41:42 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 2953 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:43 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:43 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:43 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:43 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:43 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Creating event network-vif-unplugged:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:43 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048213 Apr 11 20:41:43 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 111/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:43 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "4af039ce-a832-46f5-9c67-e57a075dec43"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Creating event network-vif-unplugged:4af039ce-a832-46f5-9c67-e57a075dec43 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034917 Apr 11 20:41:43 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 111/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "030dae9d-cc5b-4278-935b-b032bf6d29dd"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Creating event network-vif-unplugged:030dae9d-cc5b-4278-935b-b032bf6d29dd for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034088 Apr 11 20:41:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 114/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "c20d2e13-a748-4cdd-9ba0-5350f331d56b"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "c20d2e13-a748-4cdd-9ba0-5350f331d56b"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Creating event network-vif-plugged:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Creating event network-vif-unplugged:c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Creating event network-vif-plugged:c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035585 Apr 11 20:41:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 112/337] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:45 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "4af039ce-a832-46f5-9c67-e57a075dec43"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "fa937413-1cdc-4426-8707-25d48f79124c"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "fa937413-1cdc-4426-8707-25d48f79124c"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-unplugged", "status": "completed", "tag": "1380e6a6-4036-442f-8120-243f80c0e646"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "1380e6a6-4036-442f-8120-243f80c0e646"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-plugged:4af039ce-a832-46f5-9c67-e57a075dec43 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-unplugged:fa937413-1cdc-4426-8707-25d48f79124c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-plugged:fa937413-1cdc-4426-8707-25d48f79124c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-unplugged:6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-plugged:6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-unplugged:1380e6a6-4036-442f-8120-243f80c0e646 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Creating event network-vif-plugged:1380e6a6-4036-442f-8120-243f80c0e646 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.037746 Apr 11 20:41:45 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 112/338] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 20:41:45 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:46 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-plugged", "status": "completed", "tag": "030dae9d-cc5b-4278-935b-b032bf6d29dd"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Creating event network-vif-plugged:030dae9d-cc5b-4278-935b-b032bf6d29dd for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Apr 11 20:41:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 115/339] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-deleted", "tag": "030dae9d-cc5b-4278-935b-b032bf6d29dd"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] Creating event network-vif-deleted:030dae9d-cc5b-4278-935b-b032bf6d29dd for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031908 Apr 11 20:41:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 113/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-deleted", "tag": "c20d2e13-a748-4cdd-9ba0-5350f331d56b"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-deleted", "tag": "893b51e3-f5e5-41fa-aa56-913f6518dd5c"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-deleted", "tag": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a"}, {"server_uuid": "921fec20-d5dc-4387-b265-2d16a1c226f2", "name": "network-vif-deleted", "tag": "1380e6a6-4036-442f-8120-243f80c0e646"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Creating event network-vif-deleted:c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Creating event network-vif-deleted:893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Creating event network-vif-deleted:6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] Creating event network-vif-deleted:1380e6a6-4036-442f-8120-243f80c0e646 for instance 921fec20-d5dc-4387-b265-2d16a1c226f2 on user Apr 11 20:41:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.030784 Apr 11 20:41:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:49 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:52 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'services' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:41:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments/7b9f6713-befd-4589-bd9a-3defae1c71e7" status: 202 len: 0 microversion: 2.1 time: 0.169971 Apr 11 20:41:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 116/342] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:41:52 2023] DELETE /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments/7b9f6713-befd-4589-bd9a-3defae1c71e7 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-cbe03833-e809-480e-a58c-31288e921f8d tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047113 Apr 11 20:41:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:41:52 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:53 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:53 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a35b3c85-cf87-445c-ae4a-3edd50bd5d0e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.133263 Apr 11 20:41:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 114/344] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 20:41:53 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:41:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 204 len: 0 microversion: 2.20 time: 0.125331 Apr 11 20:41:54 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 117/345] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:41:54 2023] DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:54 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:41:54 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8401f445-b9cb-4fd3-b1a6-8f683230d5c2 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 200 len: 1712 microversion: 2.20 time: 0.204549 Apr 11 20:41:54 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 115/346] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:41:54 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 1712 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-unplugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Creating event network-vif-unplugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:41:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031097 Apr 11 20:41:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-deleted", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] Creating event network-vif-deleted:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:41:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036016 Apr 11 20:41:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 118/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:41:56 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534b82fe-0c07-46dd-bb21-66ad7f6b1397", "name": "network-vif-plugged", "status": "completed", "tag": "d2d4c99b-9fd2-4090-9c8a-072b6625a081"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:41:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:41:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:41:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:41:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Creating event network-vif-plugged:d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 on user Apr 11 20:41:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028541 Apr 11 20:41:56 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 116/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:41:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2055329177"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79/action" status: 202 len: 52 microversion: 2.87 time: 0.804060 Apr 11 20:42:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 116/350] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:42:01 2023] POST /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79/action => generated 52 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:07 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0773d515-4fff-41a2-bdd1-20283a1d2e03 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1745 microversion: 2.1 time: 0.170819 Apr 11 20:42:07 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 119/351] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:07 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:42:07 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=16 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:07 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=28 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:07 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:08 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:08 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e3dacb33-12cf-4279-8e4d-b64cdc9c84dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79" status: 200 len: 1689 microversion: 2.87 time: 0.191588 Apr 11 20:42:08 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 117/352] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:42:07 2023] GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5edf2514-90e6-4464-a7a9-a3570ef9bb61 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.095638 Apr 11 20:42:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:42:10 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-interface => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:11 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:11 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Creating event network-changed:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:42:11 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034401 Apr 11 20:42:11 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 120/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:11 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ea230f73-6cf7-4c15-a101-9f04d219d2b2 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/ips" status: 200 len: 103 microversion: 2.1 time: 0.036219 Apr 11 20:42:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 118/355] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:42:11 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/ips => generated 103 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "042389e0-da53-4582-ae52-c57ba7f3c396"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:12 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284810 Apr 11 20:42:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:42:12 2023] POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:12 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:13 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'services' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:42:13 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments/9482e06e-2cf5-4af8-b281-e43941df6b7c" status: 202 len: 0 microversion: 2.1 time: 0.193161 Apr 11 20:42:13 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 121/357] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:42:12 2023] DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments/9482e06e-2cf5-4af8-b281-e43941df6b7c => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-a8c50a6c-2572-4c35-81dd-ba77c1710148 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051579 Apr 11 20:42:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 119/358] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:42:13 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] HTTP exception thrown: Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 could not be found. Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Request method failure captured: Apr 11 20:42:19 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1 HTTP/1.1 Apr 11 20:42:19 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:42:19 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:42:19 user devstack@n-api.service[61908]: Connection: close Apr 11 20:42:19 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:42:19 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:42:19 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:42:19 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:42:19 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSElNImiunRlNFYGpzrauHq3mIscdNGRXPdFsPIZ6JDwok46QZMlArZdu_RbS5t21D6vnHY6FbUbXJjQSj4qvCwMIkEIu7Qor7r8cJ0xW4elxlaq0DcXgSZqC2zl25MW0ptvMJL9t_Jxvhrp-Nthk5IjSIbl8IppmVpJFFMLlcxNU8 Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Project-Id: 0ab02b2eef8d40f18b755b63d2a14c9b Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Project-Name: tempest-VolumesAdminNegativeTest-878898162 Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ab02b2eef8d40f18b755b63d2a14c9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ab02b2eef8d40f18b755b63d2a14c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ab02b2eef8d40f18b755b63d2a14c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Tenant: tempest-VolumesAdminNegativeTest-878898162 Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Tenant-Id: 0ab02b2eef8d40f18b755b63d2a14c9b Apr 11 20:42:19 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-878898162 Apr 11 20:42:19 user devstack@n-api.service[61908]: X-User: tempest-VolumesAdminNegativeTest-878898162-project-member Apr 11 20:42:19 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:42:19 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:42:19 user devstack@n-api.service[61908]: X-User-Id: af25924dd6564739a52fd957edceb143 Apr 11 20:42:19 user devstack@n-api.service[61908]: X-User-Name: tempest-VolumesAdminNegativeTest-878898162-project-member Apr 11 20:42:19 user devstack@n-api.service[61908]: method: > Apr 11 20:42:19 user devstack@n-api.service[61908]: exception: Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 could not be found. Apr 11 20:42:19 user devstack@n-api.service[61908]: action_args: {'id': '52b7250e-a85d-4c3f-93e7-ac05ebd13be1'} Apr 11 20:42:19 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 could not be found. Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 could not be found. Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 could not be found. Apr 11 20:42:19 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Returning 404 to user: Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:42:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-669ff733-243b-481e-84a7-d7cdab61006f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1" status: 404 len: 111 microversion: 2.1 time: 0.037910 Apr 11 20:42:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:19 2023] GET /compute/v2.1/servers/52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:42:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-21604152-81b8-4158-bef0-6120e88b781f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Calling method '.version_select at 0x7f72686d1900>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-21604152-81b8-4158-bef0-6120e88b781f tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189322231" status: 202 len: 0 microversion: 2.1 time: 0.027025 Apr 11 20:42:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 122/360] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:42:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189322231 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:42:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Going to try to stop instance {{(pid=61909) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 20:42:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action" status: 202 len: 0 microversion: 2.1 time: 0.104104 Apr 11 20:42:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 120/361] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:42:19 2023] POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-unplugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Creating event network-vif-unplugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:42:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031597 Apr 11 20:42:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 123/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:20 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a25c14ac-64e8-4acf-976a-dafb265a63e1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1709 microversion: 2.1 time: 0.546824 Apr 11 20:42:20 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 120/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:19 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1709 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:42:21 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:42:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037594 Apr 11 20:42:21 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] HTTP exception thrown: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Request method failure captured: Apr 11 20:42:33 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 HTTP/1.1 Apr 11 20:42:33 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:42:33 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:42:33 user devstack@n-api.service[61907]: Connection: close Apr 11 20:42:33 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:42:33 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:42:33 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:42:33 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:42:33 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcV7s8psVyCj-2u-F-VObKiDDnyEaHJLckX92nWdAuURd9ljGVuX_5mofJp7KzRfJXIadOgdB1C9rvN87BAh9rNS_PxXTjjFFkX2mSnSFUNR9ytQv8W772wcMbTHQNOiQfRN1tp_wWphONTIr4m9-4qQxrTe1hjS02fze-beBctqBvY Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Project-Id: d89f013fadbe411caf0a6f2856a11135 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Tenant: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Tenant-Id: d89f013fadbe411caf0a6f2856a11135 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-User: tempest-TaggedBootDevicesTest_v242-280116242-project-member Apr 11 20:42:33 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:42:33 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:42:33 user devstack@n-api.service[61907]: X-User-Id: 928391a137c94107af4dd426b9a086f7 Apr 11 20:42:33 user devstack@n-api.service[61907]: X-User-Name: tempest-TaggedBootDevicesTest_v242-280116242-project-member Apr 11 20:42:33 user devstack@n-api.service[61907]: method: > Apr 11 20:42:33 user devstack@n-api.service[61907]: exception: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:33 user devstack@n-api.service[61907]: action_args: {'id': '921fec20-d5dc-4387-b265-2d16a1c226f2'} Apr 11 20:42:33 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:33 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:42:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Returning 404 to user: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:42:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a9647231-cc97-4b81-8585-b9fa40d737cd tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 404 len: 111 microversion: 2.42 time: 0.038768 Apr 11 20:42:33 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 124/365] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:42:33 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:42:33 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-215cfd87-6994-42d6-b44b-e04bc7f85e15 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '.version_select at 0x7f72686bda20>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-215cfd87-6994-42d6-b44b-e04bc7f85e15 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724644128" status: 204 len: 0 microversion: 2.42 time: 0.027832 Apr 11 20:42:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 121/366] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 20:42:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724644128 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:42:35 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:35 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:35 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-fbed4533-2411-49bc-abe3-0a1f7fb059ca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: .version_select at 0x7f7268553520>, body: {"keypair": {"name": "tempest-keypair-668966515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEd9qv94tRkT45FuNHkmLkkpIBVswbIY16UkibPoyN1X5rD6j733moSAHr5g2t/t4SlwcLf7Ob21UpIrp1iW3TfXNOEKKmcMWCuF6+soRAAJS05EI3VRMpEWmnJ6ZTAqQ=="}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:35 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-fbed4533-2411-49bc-abe3-0a1f7fb059ca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:42:35 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-fbed4533-2411-49bc-abe3-0a1f7fb059ca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:42:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-fbed4533-2411-49bc-abe3-0a1f7fb059ca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158892 Apr 11 20:42:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 122/367] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:42:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-197605793", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0"}], "security_groups": [{"name": "tempest-securitygroup--53652937"}], "key_name": "tempest-keypair-668966515", "user_data": "}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] validate_networks() for [('2e7f3602-ac71-4117-82aa-d6e25c53d5d0', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] HTTP exception thrown: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Request method failure captured: Apr 11 20:42:37 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 HTTP/1.1 Apr 11 20:42:37 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:42:37 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:42:37 user devstack@n-api.service[61908]: Connection: close Apr 11 20:42:37 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:42:37 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:42:37 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:42:37 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:42:37 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcV7s8psVyCj-2u-F-VObKiDDnyEaHJLckX92nWdAuURd9ljGVuX_5mofJp7KzRfJXIadOgdB1C9rvN87BAh9rNS_PxXTjjFFkX2mSnSFUNR9ytQv8W772wcMbTHQNOiQfRN1tp_wWphONTIr4m9-4qQxrTe1hjS02fze-beBctqBvY Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Project-Id: d89f013fadbe411caf0a6f2856a11135 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Tenant: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Tenant-Id: d89f013fadbe411caf0a6f2856a11135 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-User: tempest-TaggedBootDevicesTest_v242-280116242-project-member Apr 11 20:42:37 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:42:37 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:42:37 user devstack@n-api.service[61908]: X-User-Id: 928391a137c94107af4dd426b9a086f7 Apr 11 20:42:37 user devstack@n-api.service[61908]: X-User-Name: tempest-TaggedBootDevicesTest_v242-280116242-project-member Apr 11 20:42:37 user devstack@n-api.service[61908]: method: > Apr 11 20:42:37 user devstack@n-api.service[61908]: exception: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61908]: action_args: {'id': '921fec20-d5dc-4387-b265-2d16a1c226f2'} Apr 11 20:42:37 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Returning 404 to user: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:42:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-fd833dfc-e7b2-49d8-afc3-f9848427480e tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 404 len: 111 microversion: 2.42 time: 0.029067 Apr 11 20:42:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 122/368] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:42:37 2023] DELETE /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] HTTP exception thrown: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Request method failure captured: Apr 11 20:42:37 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 HTTP/1.1 Apr 11 20:42:37 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:42:37 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:42:37 user devstack@n-api.service[61909]: Connection: close Apr 11 20:42:37 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:42:37 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:42:37 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:42:37 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:42:37 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcV7s8psVyCj-2u-F-VObKiDDnyEaHJLckX92nWdAuURd9ljGVuX_5mofJp7KzRfJXIadOgdB1C9rvN87BAh9rNS_PxXTjjFFkX2mSnSFUNR9ytQv8W772wcMbTHQNOiQfRN1tp_wWphONTIr4m9-4qQxrTe1hjS02fze-beBctqBvY Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Project-Id: d89f013fadbe411caf0a6f2856a11135 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d89f013fadbe411caf0a6f2856a11135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Tenant: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Tenant-Id: d89f013fadbe411caf0a6f2856a11135 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-280116242 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-User: tempest-TaggedBootDevicesTest_v242-280116242-project-member Apr 11 20:42:37 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:42:37 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:42:37 user devstack@n-api.service[61909]: X-User-Id: 928391a137c94107af4dd426b9a086f7 Apr 11 20:42:37 user devstack@n-api.service[61909]: X-User-Name: tempest-TaggedBootDevicesTest_v242-280116242-project-member Apr 11 20:42:37 user devstack@n-api.service[61909]: method: > Apr 11 20:42:37 user devstack@n-api.service[61909]: exception: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61909]: action_args: {'id': '921fec20-d5dc-4387-b265-2d16a1c226f2'} Apr 11 20:42:37 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. Apr 11 20:42:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Returning 404 to user: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:42:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f7fdcab1-d848-4393-a903-a47c68efc581 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2" status: 404 len: 111 microversion: 2.42 time: 0.030381 Apr 11 20:42:37 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 123/369] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:42:37 2023] GET /compute/v2.1/servers/921fec20-d5dc-4387-b265-2d16a1c226f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:42:37 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:42:37 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.638512 Apr 11 20:42:37 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 125/370] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:42:37 2023] POST /compute/v2.1/servers => generated 398 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:42:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ab8f4cb3-be5c-43df-bd35-3ac0754112a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:38 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ab8f4cb3-be5c-43df-bd35-3ac0754112a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:38 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-ab8f4cb3-be5c-43df-bd35-3ac0754112a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ab8f4cb3-be5c-43df-bd35-3ac0754112a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 200 len: 1234 microversion: 2.1 time: 0.075065 Apr 11 20:42:38 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 123/371] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:38 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:42:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Creating event network-changed:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:42:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029329 Apr 11 20:42:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 124/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ee347cca-27e0-4026-8d52-3c894fa29828 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047918 Apr 11 20:42:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 126/373] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:42:42 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:42:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "name": "network-vif-plugged", "status": "completed", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Creating event network-vif-plugged:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:42:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036449 Apr 11 20:42:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 124/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-71eeabbc-dcca-4a0a-bd3e-69f5f20d15a6 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '.version_select at 0x7f7268aef7f0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-71eeabbc-dcca-4a0a-bd3e-69f5f20d15a6 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb" status: 204 len: 0 microversion: 2.1 time: 0.237095 Apr 11 20:42:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 125/375] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:44 2023] DELETE /compute/v2.1/images/1906d4ae-83e8-471b-b5db-3d5abb7016eb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:42:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 204 len: 0 microversion: 2.1 time: 0.133669 Apr 11 20:42:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 127/376] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:42:44 2023] DELETE /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HTTP exception thrown: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Request method failure captured: Apr 11 20:42:44 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 HTTP/1.1 Apr 11 20:42:44 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:42:44 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:42:44 user devstack@n-api.service[61909]: Connection: close Apr 11 20:42:44 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:42:44 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:42:44 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:42:44 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:42:44 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSGTaRVHUu5CiHmz8Fc3-VT3tP1y_11C1pMO47q6lKUfkhUI4Bq6OPT2UOzhJujXc5-1V5blLhmxGk1LcTaZ2_Jwk03qy0we6SHzLLX8nH_ld1XQLERH0vPAcLPX-fZFfF5X3yFxL58nouG-WjtndR6t8Nu2cjv8cM1EBKLaxAa7N4 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Project-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Tenant-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:42:44 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:42:44 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:42:44 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:42:44 user devstack@n-api.service[61909]: X-User-Id: f82468d207064eb288a2c8a167cd7d9d Apr 11 20:42:44 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:42:44 user devstack@n-api.service[61909]: method: > Apr 11 20:42:44 user devstack@n-api.service[61909]: exception: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:42:44 user devstack@n-api.service[61909]: action_args: {'id': '534b82fe-0c07-46dd-bb21-66ad7f6b1397'} Apr 11 20:42:44 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:42:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Returning 404 to user: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f57ac1ed-490c-4821-8307-92ad7e7e9d5b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 404 len: 111 microversion: 2.20 time: 0.062282 Apr 11 20:42:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 126/377] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:42:44 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:42:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-94109a98-b4fe-4c3a-b158-529be09ad7fd tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '.version_select at 0x7f7268569120>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-94109a98-b4fe-4c3a-b158-529be09ad7fd tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950690295" status: 204 len: 0 microversion: 2.20 time: 0.027623 Apr 11 20:42:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 128/378] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 20:42:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950690295 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:42:44 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:44 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cc59e7bc-0867-49d3-9b02-671e545c86d7 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 200 len: 1677 microversion: 2.1 time: 0.277613 Apr 11 20:42:44 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 125/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:44 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "name": "network-vif-plugged", "status": "completed", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}, {"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}, {"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Creating event network-vif-plugged:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Creating event network-vif-unplugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Creating event network-vif-plugged:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:42:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.036983 Apr 11 20:42:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 127/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:44 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4bc68166-00ec-4d5e-8795-1f5c9a70aea4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'create', calling method: .version_select at 0x7f726856be20>, body: {"keypair": {"name": "tempest-keypair-545600492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXzG/+iyFuLq/UP2Nf5869PwPaIxZUHlcTfcaQgIRL9ghHbGCVYa9ZHifqpcdGOoDPU/AR9Vn/W3qYR1rkx0sBJJpcHf1bVwdR/Ko66Ttz3Mo82/6YMPmg7BC5ao/FyXQ=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:45 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-4bc68166-00ec-4d5e-8795-1f5c9a70aea4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for project 0d5fce55f8224068805593f94d5f2d36. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:42:45 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-4bc68166-00ec-4d5e-8795-1f5c9a70aea4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for user f82468d207064eb288a2c8a167cd7d9d and project 0d5fce55f8224068805593f94d5f2d36. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:42:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-4bc68166-00ec-4d5e-8795-1f5c9a70aea4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054844 Apr 11 20:42:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 129/381] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 20:42:45 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 20:42:46 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5fb157-6ca9-4e9f-87c6-11300909fdca", "name": "network-vif-deleted", "tag": "1ef9bc31-64d9-48ac-b54c-80d0b4487897"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] Creating event network-vif-deleted:1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca on user Apr 11 20:42:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038477 Apr 11 20:42:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:47 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-345208448", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "88ce8103-e878-4fd8-b5cc-78a05d373fc5"}], "security_groups": [{"name": "tempest-securitygroup--752493158"}], "key_name": "tempest-keypair-545600492", "user_data": "}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:47 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] validate_networks() for [('88ce8103-e878-4fd8-b5cc-78a05d373fc5', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for project 0d5fce55f8224068805593f94d5f2d36. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting quotas for user f82468d207064eb288a2c8a167cd7d9d and project 0d5fce55f8224068805593f94d5f2d36. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:42:48 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:42:48 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.130324 Apr 11 20:42:48 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 128/383] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:42:47 2023] POST /compute/v2.1/servers => generated 399 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:42:48 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:48 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6640ac3e-344b-4ba5-ad89-0e4550121dca tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:48 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6640ac3e-344b-4ba5-ad89-0e4550121dca tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:48 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-6640ac3e-344b-4ba5-ad89-0e4550121dca tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:48 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-6640ac3e-344b-4ba5-ad89-0e4550121dca tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:48 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-6640ac3e-344b-4ba5-ad89-0e4550121dca tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6640ac3e-344b-4ba5-ad89-0e4550121dca tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1274 microversion: 2.20 time: 0.096884 Apr 11 20:42:48 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 130/384] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:42:48 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:42:51 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Creating event network-changed:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:42:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030377 Apr 11 20:42:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 127/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-plugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Creating event network-vif-plugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:42:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029217 Apr 11 20:42:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-plugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:55 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Creating event network-vif-plugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:42:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049922 Apr 11 20:42:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 131/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:42:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1539085704", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] validate_networks() for [('1ee91002-b796-478b-b740-f3297b37e1f0', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for user dce0b6fa6d9546c8a04b7a4a5f93e0c7 and project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:42:58 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:42:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.663041 Apr 11 20:42:58 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 128/388] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:42:58 2023] POST /compute/v2.1/servers => generated 381 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:42:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-57aa658a-dcdc-45ba-9962-b53f6d0191d6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:58 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-57aa658a-dcdc-45ba-9962-b53f6d0191d6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:58 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-57aa658a-dcdc-45ba-9962-b53f6d0191d6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-57aa658a-dcdc-45ba-9962-b53f6d0191d6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1216 microversion: 2.1 time: 0.082765 Apr 11 20:42:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:58 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=12 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-57617171", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] validate_networks() for [('1ee91002-b796-478b-b740-f3297b37e1f0', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for user dce0b6fa6d9546c8a04b7a4a5f93e0c7 and project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:42:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:42:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.558360 Apr 11 20:42:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 132/390] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:42:59 2023] POST /compute/v2.1/servers => generated 381 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:42:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-81a1135d-b5a4-4f8d-ae67-fe4dc5119df8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:42:59 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-81a1135d-b5a4-4f8d-ae67-fe4dc5119df8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:42:59 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-81a1135d-b5a4-4f8d-ae67-fe4dc5119df8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:42:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-81a1135d-b5a4-4f8d-ae67-fe4dc5119df8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 200 len: 1214 microversion: 2.1 time: 0.069092 Apr 11 20:42:59 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 129/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:42:59 2023] GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Creating event network-changed:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:43:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 Apr 11 20:43:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:02 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Creating event network-changed:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:43:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027911 Apr 11 20:43:02 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 133/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=17 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a085a216-7f52-4f1f-b2cc-7fb755621a1b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073024 Apr 11 20:43:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 130/394] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:43:03 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:03 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:43:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 Apr 11 20:43:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 134/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:03 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d5dca958-8b6d-448c-859b-d43e8b487fb2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1677 microversion: 2.1 time: 0.306119 Apr 11 20:43:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 132/396] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:03 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1677 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:03 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9360cede-53e1-41c2-8990-7dc1285865b4 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1677 microversion: 2.1 time: 0.178715 Apr 11 20:43:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 131/397] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:03 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:04 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9e44a7f7-24f7-4a92-bbd1-11ea428f588a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1677 microversion: 2.1 time: 0.153910 Apr 11 20:43:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 135/398] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:04 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:43:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:43:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:43:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038435 Apr 11 20:43:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 133/399] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1536554826"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:08 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-565746598", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761"}]}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:08 user devstack@n-api.service[61908]: INFO nova.network.security_group_api [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Removing security group a4e13d5c-f130-4a98-9aac-b904c03fd15c from port cff9d1b4-18f3-4450-8d38-f230812fb66e Apr 11 20:43:08 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] validate_networks() for [('6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:43:08 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for user 1d5cb62cc3844248be2e4456d970ccdf and project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:43:09 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:43:09 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3da085f6-2d79-45e4-a966-07e7b5942e37 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/action" status: 202 len: 0 microversion: 2.1 time: 1.012811 Apr 11 20:43:09 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 132/400] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:43:08 2023] POST /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/action => generated 0 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:09 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=23 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.936819 Apr 11 20:43:09 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 136/401] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:43:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:43:09 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Creating event network-changed:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:43:09 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9680093b-d98d-4b0c-a749-3eba62a12848 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:09 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-9680093b-d98d-4b0c-a749-3eba62a12848 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:09 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061918 Apr 11 20:43:09 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 134/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:09 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9680093b-d98d-4b0c-a749-3eba62a12848 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:09 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9680093b-d98d-4b0c-a749-3eba62a12848 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:09 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9680093b-d98d-4b0c-a749-3eba62a12848 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:09 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9680093b-d98d-4b0c-a749-3eba62a12848 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1394 microversion: 2.87 time: 0.099506 Apr 11 20:43:09 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 133/403] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:43:09 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1394 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Creating event network-changed:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:43:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036941 Apr 11 20:43:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 137/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'services' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:43:10 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:10 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f4ee6dc1-e49e-4339-af9e-a9c6a18ea41b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1686 microversion: 2.1 time: 0.237437 Apr 11 20:43:10 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:10 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1686 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments/1f60ce4f-bf85-446c-bc26-6af1cc7dc546" status: 202 len: 0 microversion: 2.1 time: 0.272650 Apr 11 20:43:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 134/406] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:43:10 2023] DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments/1f60ce4f-bf85-446c-bc26-6af1cc7dc546 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-4c6e3e5b-ad75-4d7d-87c0-d52d7c26ff3b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053810 Apr 11 20:43:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 138/407] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:43:10 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Creating event network-changed:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:43:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033335 Apr 11 20:43:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 136/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=10 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=13 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:43:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038560 Apr 11 20:43:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 135/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=12 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=24 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:43:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038975 Apr 11 20:43:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 139/410] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=5 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=9 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:28 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:28 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-572c895c-7d2c-44c6-bc0e-ae98eb0e4b62 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 200 len: 1541 microversion: 2.1 time: 0.155417 Apr 11 20:43:28 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 137/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:28 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 1541 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] HTTP exception thrown: Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca could not be found. Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Request method failure captured: Apr 11 20:43:34 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca HTTP/1.1 Apr 11 20:43:34 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:43:34 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:43:34 user devstack@n-api.service[61908]: Connection: close Apr 11 20:43:34 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:43:34 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:43:34 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:43:34 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:43:34 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSMxRzLfP7Ydx-nZZuvIYuMxCOvTEy7OBNRwVT4VqnspRh4Tkik3da4W76XjhQjYTtbjQ5PdKzRUndxlWTHONRgp1FQlm7KOn11qJpt7B-ID3YcQAsi0VYJcAifyB6jrOHjClv3s5jhl-FxyQmhfVpXxkQmrDjuNZzbKaUwgGPnmRE Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Project-Id: e8329ebeb037462d864dd5cf8aefc6b8 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServerStableDeviceRescueTest-435801344 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e8329ebeb037462d864dd5cf8aefc6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e8329ebeb037462d864dd5cf8aefc6b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e8329ebeb037462d864dd5cf8aefc6b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Tenant: tempest-ServerStableDeviceRescueTest-435801344 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Tenant-Id: e8329ebeb037462d864dd5cf8aefc6b8 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-435801344 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-User: tempest-ServerStableDeviceRescueTest-435801344-project-member Apr 11 20:43:34 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:43:34 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:43:34 user devstack@n-api.service[61908]: X-User-Id: 127b201d67de4bacaed034d4becdc955 Apr 11 20:43:34 user devstack@n-api.service[61908]: X-User-Name: tempest-ServerStableDeviceRescueTest-435801344-project-member Apr 11 20:43:34 user devstack@n-api.service[61908]: method: > Apr 11 20:43:34 user devstack@n-api.service[61908]: exception: Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca could not be found. Apr 11 20:43:34 user devstack@n-api.service[61908]: action_args: {'id': 'fe5fb157-6ca9-4e9f-87c6-11300909fdca'} Apr 11 20:43:34 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca could not be found. Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca could not be found. Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca could not be found. Apr 11 20:43:34 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:43:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Returning 404 to user: Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:43:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-99ef5d27-74fa-482a-814d-9ce3f81b5fdc tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca" status: 404 len: 111 microversion: 2.1 time: 0.029850 Apr 11 20:43:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:34 2023] GET /compute/v2.1/servers/fe5fb157-6ca9-4e9f-87c6-11300909fdca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:43:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-997dd6f1-6f9b-4daf-b2ef-0880c78e9bad tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Calling method '.version_select at 0x7f7268665b40>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-997dd6f1-6f9b-4daf-b2ef-0880c78e9bad tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032053389" status: 202 len: 0 microversion: 2.1 time: 0.020308 Apr 11 20:43:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 140/413] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 20:43:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032053389 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:39 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:39 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:39 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-1bf10078-b641-493d-ad48-e05d27fc0fa3 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1585 microversion: 2.20 time: 0.153254 Apr 11 20:43:39 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 138/414] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:43:38 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1585 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:49 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-09f05b3a-1c94-459c-b46e-f21426039459 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 200 len: 1502 microversion: 2.1 time: 0.170204 Apr 11 20:43:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 137/415] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:43:49 2023] GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:59 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:43:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-fcff26db-f640-49b0-b0cb-d5ffcbf9a6d4 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1767 microversion: 2.87 time: 0.224421 Apr 11 20:43:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 141/416] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:43:59 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1767 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-99ee8b52-3989-4d2f-a9d5-da297c52968a tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049150 Apr 11 20:44:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:44:00 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HTTP exception thrown: Instance 6af82381-69fc-47e5-a16f-cea88c569240 is not attached to volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Request method failure captured: Apr 11 20:44:00 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments/1f60ce4f-bf85-446c-bc26-6af1cc7dc546 HTTP/1.1 Apr 11 20:44:00 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:44:00 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:44:00 user devstack@n-api.service[61908]: Connection: close Apr 11 20:44:00 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:44:00 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:44:00 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:44:00 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:44:00 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcViOlS8LEd3QPJ88kbES3EiCucmL9xwWjHlXB3MG3neyqH9atP2HhcjcxQSr95ePAyf4DWYqmmMOtk61u9xz3FaOSiCJ1ES-6kqjo4shptrKTUJ1pM_9KjZS6ml3Vp88SetSH0-n3wgcnfFQx_MxqenK8Bjs9S9qUgR-JFKyG6Wut4 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Project-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Tenant: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Tenant-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:44:00 user devstack@n-api.service[61908]: X-User: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:44:00 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:44:00 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:44:00 user devstack@n-api.service[61908]: X-User-Id: 0a70ed7ce13442e6b7f6f62b960520ad Apr 11 20:44:00 user devstack@n-api.service[61908]: X-User-Name: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:44:00 user devstack@n-api.service[61908]: method: > Apr 11 20:44:00 user devstack@n-api.service[61908]: exception: Instance 6af82381-69fc-47e5-a16f-cea88c569240 is not attached to volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 Apr 11 20:44:00 user devstack@n-api.service[61908]: action_args: {'server_id': '6af82381-69fc-47e5-a16f-cea88c569240', 'id': '1f60ce4f-bf85-446c-bc26-6af1cc7dc546'} Apr 11 20:44:00 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1f60ce4f-bf85-446c-bc26-6af1cc7dc546. Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af82381-69fc-47e5-a16f-cea88c569240 is not attached to volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af82381-69fc-47e5-a16f-cea88c569240 is not attached to volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 Apr 11 20:44:00 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Returning 404 to user: Instance 6af82381-69fc-47e5-a16f-cea88c569240 is not attached to volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:44:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-408e4c27-eda2-4c39-b3f8-bea4ce996538 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments/1f60ce4f-bf85-446c-bc26-6af1cc7dc546" status: 404 len: 154 microversion: 2.1 time: 0.104734 Apr 11 20:44:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:44:00 2023] DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240/os-volume_attachments/1f60ce4f-bf85-446c-bc26-6af1cc7dc546 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:44:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 204 len: 0 microversion: 2.1 time: 0.139573 Apr 11 20:44:02 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 142/419] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:44:01 2023] DELETE /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:02 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e033db96-124f-42eb-af6a-4f70a84a11b0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 200 len: 1540 microversion: 2.1 time: 0.239798 Apr 11 20:44:02 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:02 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 1540 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-unplugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Creating event network-vif-unplugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:44:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049916 Apr 11 20:44:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 139/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-deleted", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] Creating event network-vif-deleted:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:44:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 Apr 11 20:44:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 143/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af82381-69fc-47e5-a16f-cea88c569240", "name": "network-vif-plugged", "status": "completed", "tag": "cff9d1b4-18f3-4450-8d38-f230812fb66e"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Creating event network-vif-plugged:cff9d1b4-18f3-4450-8d38-f230812fb66e for instance 6af82381-69fc-47e5-a16f-cea88c569240 on user Apr 11 20:44:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028908 Apr 11 20:44:04 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 141/423] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:05 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f47f9c84-8555-40c5-a818-0dd96d8a81ef tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1677 microversion: 2.1 time: 0.152063 Apr 11 20:44:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 140/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:05 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfcd112c-1532-4aa6-9cc4-b03448a34609"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276203 Apr 11 20:44:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 144/425] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:44:05 2023] POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Going to try to start instance {{(pid=61909) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 20:44:10 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action" status: 202 len: 0 microversion: 2.1 time: 0.071820 Apr 11 20:44:10 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 142/426] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:44:10 2023] POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-0f4b8990-6a18-40ab-a161-fd7caed14144 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1695 microversion: 2.1 time: 0.199909 Apr 11 20:44:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 141/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:10 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1695 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Old instance type m1.nano, new instance type m1.micro {{(pid=61907) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:44:12 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:44:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/action" status: 202 len: 0 microversion: 2.1 time: 0.271647 Apr 11 20:44:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 145/428] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:44:12 2023] POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:12 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f2621de5-9723-44fd-b0d7-96c89ea37f67 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1732 microversion: 2.1 time: 0.172500 Apr 11 20:44:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:12 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:15 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-unplugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Creating event network-vif-unplugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:44:15 user devstack@n-api.service[61908]: DEBUG nova.compute.api [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61908) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:44:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053764 Apr 11 20:44:15 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 142/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:15 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:15 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:44:15 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052531 Apr 11 20:44:15 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 146/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:17 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:44:17 user devstack@n-api.service[61909]: DEBUG nova.compute.api [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61909) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:44:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045332 Apr 11 20:44:17 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 144/432] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:44:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031530 Apr 11 20:44:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:44:27 user devstack@n-api.service[61907]: DEBUG nova.compute.api [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61907) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:44:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056270 Apr 11 20:44:27 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 147/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:28 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-098982af-c9a2-431e-ad60-70da0f92fcc5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.095589 Apr 11 20:44:28 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:44:28 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:28 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:28 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=26 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:28 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-860608246", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "5986aa1d-df23-4d2b-9e22-0030e7716fd4"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:28 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] validate_networks() for [('5986aa1d-df23-4d2b-9e22-0030e7716fd4', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting quotas for project 1982dc9f62644e2b8a541dc25854a6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting quotas for user 94e4de8a85394d258268ff4304eccb2d and project 1982dc9f62644e2b8a541dc25854a6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:44:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.888568 Apr 11 20:44:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 144/436] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:44:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:44:29 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-910ab5fb-4b02-4e1d-80a7-b650f495fafc tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:29 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-910ab5fb-4b02-4e1d-80a7-b650f495fafc tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:29 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-910ab5fb-4b02-4e1d-80a7-b650f495fafc tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-910ab5fb-4b02-4e1d-80a7-b650f495fafc tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff" status: 200 len: 1212 microversion: 2.1 time: 0.091481 Apr 11 20:44:29 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:29 2023] GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:29 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}, {"name": "network-changed", "server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:44:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Creating event network-changed:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:29 user devstack@n-api.service[61909]: DEBUG nova.compute.api [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61909) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053773 Apr 11 20:44:29 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 146/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:29 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-76cab9ab-1cea-4e76-ab9c-8330852bd478 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/ips" status: 200 len: 107 microversion: 2.1 time: 0.039024 Apr 11 20:44:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 145/439] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:44:29 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/ips => generated 107 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a6c57cf-e717-411e-98df-be3d3706bc6c"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360665 Apr 11 20:44:31 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 149/440] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:44:31 2023] POST /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:33 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c52ef94-8660-49a4-8105-5b63bfb187ff", "tag": "704fb865-76f6-4e89-b6f8-b69854f4bcc6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:33 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:33 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:33 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:33 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Creating event network-changed:704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff on user Apr 11 20:44:33 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057497 Apr 11 20:44:33 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 147/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c52ef94-8660-49a4-8105-5b63bfb187ff", "name": "network-vif-plugged", "status": "completed", "tag": "704fb865-76f6-4e89-b6f8-b69854f4bcc6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Creating event network-vif-plugged:704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff on user Apr 11 20:44:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Apr 11 20:44:35 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 146/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:37 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c52ef94-8660-49a4-8105-5b63bfb187ff", "name": "network-vif-plugged", "status": "completed", "tag": "704fb865-76f6-4e89-b6f8-b69854f4bcc6"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:37 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:37 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Creating event network-vif-plugged:704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff on user Apr 11 20:44:37 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028138 Apr 11 20:44:37 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 150/443] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-fadfe53e-f1d0-4eb3-a9e5-db50917b59f0 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.095017 Apr 11 20:44:39 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 148/444] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 20:44:39 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:44:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-51923632-42b9-4ec4-bd68-03c1dd683137 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: .version_select at 0x7f726841eb90>, body: {"keypair": {"name": "tempest-keypair-1283781213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADHO2g4Wxo5uFCOEdCVbkMLrFL9fP1gcWaAZRsI44Qk7/GCV2Jx9IoTZMmvhldVm5kgL8hr47CmfuErH7Fbg6zlJ3CQ3hyZ8RhmjcLlo4w+Vva9kQGnWHeqbhqqYAh62g=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:39 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-51923632-42b9-4ec4-bd68-03c1dd683137 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:44:39 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-51923632-42b9-4ec4-bd68-03c1dd683137 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:44:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-51923632-42b9-4ec4-bd68-03c1dd683137 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043916 Apr 11 20:44:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 147/445] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:44:39 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Creating event network-changed:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:44:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037619 Apr 11 20:44:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 151/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-50e40d38-83f5-4c45-8a1b-88962a116e0b tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/ips" status: 200 len: 110 microversion: 2.20 time: 0.036998 Apr 11 20:44:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 149/447] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 20:44:40 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-78834662", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0"}], "security_groups": [{"name": "tempest-securitygroup--429693828"}], "key_name": "tempest-keypair-1283781213", "user_data": "}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] validate_networks() for [('2e7f3602-ac71-4117-82aa-d6e25c53d5d0', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:42 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'flavor' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:44:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:44:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.560240 Apr 11 20:44:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 148/448] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:44:42 2023] POST /compute/v2.1/servers => generated 399 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:44:42 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0ad07ba0-b681-45d2-a1e9-ee756862d4f5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:42 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0ad07ba0-b681-45d2-a1e9-ee756862d4f5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:42 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-0ad07ba0-b681-45d2-a1e9-ee756862d4f5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:42 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0ad07ba0-b681-45d2-a1e9-ee756862d4f5 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 200 len: 1234 microversion: 2.1 time: 0.073221 Apr 11 20:44:42 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 150/449] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:42 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 1234 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/action" status: 202 len: 0 microversion: 2.20 time: 0.889806 Apr 11 20:44:43 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 152/450] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:44:42 2023] POST /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:43 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-00affb37-eddb-4de0-8fdd-6697030f183a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1710 microversion: 2.20 time: 0.275569 Apr 11 20:44:43 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-unplugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:43 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 149/451] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:44:43 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1710 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:44:43 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:43 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:43 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:43 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Creating event network-vif-unplugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:44:43 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028445 Apr 11 20:44:43 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 151/452] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-plugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Creating event network-vif-plugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:44:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041420 Apr 11 20:44:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 153/453] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:46 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Creating event network-changed:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:44:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037013 Apr 11 20:44:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 150/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:48 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:48 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Creating event network-changed:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:44:48 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048772 Apr 11 20:44:48 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:50 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:44:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d/action" status: 200 len: 32 microversion: 2.1 time: 0.125019 Apr 11 20:44:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 154/456] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:44:49 2023] POST /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d/action => generated 32 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:50 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:50 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "name": "network-vif-plugged", "status": "completed", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}, {"server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "name": "network-vif-plugged", "status": "completed", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-30cd394f-fcd6-4330-a59f-9f21213f974e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 200 len: 1508 microversion: 2.1 time: 0.161421 Apr 11 20:44:50 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 151/457] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:50 2023] GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Creating event network-vif-plugged:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:44:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Creating event network-vif-plugged:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:44:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040453 Apr 11 20:44:50 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 153/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-unplugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Creating event network-vif-unplugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:44:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033956 Apr 11 20:44:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 155/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HTTP exception thrown: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Request method failure captured: Apr 11 20:44:52 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 HTTP/1.1 Apr 11 20:44:52 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:44:52 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:44:52 user devstack@n-api.service[61908]: Connection: close Apr 11 20:44:52 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:44:52 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:44:52 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:44:52 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:44:52 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcViOlS8LEd3QPJ88kbES3EiCucmL9xwWjHlXB3MG3neyqH9atP2HhcjcxQSr95ePAyf4DWYqmmMOtk61u9xz3FaOSiCJ1ES-6kqjo4shptrKTUJ1pM_9KjZS6ml3Vp88SetSH0-n3wgcnfFQx_MxqenK8Bjs9S9qUgR-JFKyG6Wut4 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Project-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Tenant: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Tenant-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:44:52 user devstack@n-api.service[61908]: X-User: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:44:52 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:44:52 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:44:52 user devstack@n-api.service[61908]: X-User-Id: 0a70ed7ce13442e6b7f6f62b960520ad Apr 11 20:44:52 user devstack@n-api.service[61908]: X-User-Name: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:44:52 user devstack@n-api.service[61908]: method: > Apr 11 20:44:52 user devstack@n-api.service[61908]: exception: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. Apr 11 20:44:52 user devstack@n-api.service[61908]: action_args: {'id': '6af82381-69fc-47e5-a16f-cea88c569240'} Apr 11 20:44:52 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. Apr 11 20:44:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:44:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Returning 404 to user: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:44:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-71e0276a-388b-4639-ac77-5141c0801ec5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240" status: 404 len: 111 microversion: 2.1 time: 0.215001 Apr 11 20:44:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 152/460] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:52 2023] GET /compute/v2.1/servers/6af82381-69fc-47e5-a16f-cea88c569240 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:44:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-7f9325a5-f752-400c-be9b-a952b6c18927 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '.version_select at 0x7f72684d8f70>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-7f9325a5-f752-400c-be9b-a952b6c18927 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-338876043" status: 202 len: 0 microversion: 2.1 time: 0.024344 Apr 11 20:44:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 11 20:44:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-338876043 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:44:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:44:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029457 Apr 11 20:44:53 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 156/462] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f568815b-13b6-4d0c-9f74-382f34e60f14 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'create', calling method: .version_select at 0x7f72686bea70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1187350393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgoaav2PRI5VZHoMp36RWFkGeyFgjBLkoPgkMM2Hm65e/3oSHCaUfGRxdpsPwOI/1U0NM4gRMKIb9KS0QfuAoBhUYfJpTYnlQ7qj7Mn/zb/HY5zoBAOJEN0G31zbRJyBg=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:54 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:54 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=16 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:54 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-f568815b-13b6-4d0c-9f74-382f34e60f14 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for project cdd62a4c803247588716e71c25c62b05. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:44:54 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-f568815b-13b6-4d0c-9f74-382f34e60f14 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for user 0a70ed7ce13442e6b7f6f62b960520ad and project cdd62a4c803247588716e71c25c62b05. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:44:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f568815b-13b6-4d0c-9f74-382f34e60f14 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049807 Apr 11 20:44:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 153/463] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:44:54 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:54 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-386756076", "imageRef": "d90454ee-0320-44ce-8994-3b5c9ecb8abb", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1187350393", "networks": [{"uuid": "015d6542-ba34-4e59-8cbe-3f538cd1f769"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:54 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:54 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] validate_networks() for [('015d6542-ba34-4e59-8cbe-3f538cd1f769', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:44:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:44:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:44:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039874 Apr 11 20:44:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 157/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for project cdd62a4c803247588716e71c25c62b05. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting quotas for user 0a70ed7ce13442e6b7f6f62b960520ad and project cdd62a4c803247588716e71c25c62b05. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:44:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d90454ee-0320-44ce-8994-3b5c9ecb8abb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:44:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.628696 Apr 11 20:44:55 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 155/465] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:44:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:44:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c5925fe5-aac2-4e50-a188-7eeef8ce2766 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:44:55 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c5925fe5-aac2-4e50-a188-7eeef8ce2766 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:44:55 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-c5925fe5-aac2-4e50-a188-7eeef8ce2766 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:44:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c5925fe5-aac2-4e50-a188-7eeef8ce2766 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1252 microversion: 2.1 time: 0.089658 Apr 11 20:44:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 154/466] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:44:55 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1252 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:44:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:44:58 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=25 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:44:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:44:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:44:58 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:44:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Creating event network-changed:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:44:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036111 Apr 11 20:44:58 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 158/467] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:44:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "5891e9c1-e817-4a4a-8c05-89f0840fc343"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=27 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:00 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'flavor' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:45:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390/action" status: 200 len: 29 microversion: 2.87 time: 0.557047 Apr 11 20:45:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 156/468] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:45:00 2023] POST /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390/action => generated 29 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=27 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:00 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3c7e8b38-03e3-44a4-ba68-5d3d065683cd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1773 microversion: 2.87 time: 0.358089 Apr 11 20:45:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 155/469] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:45:00 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1773 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:45:01 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-2a4f13ee-285a-480e-ade3-4e532d8e5529 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1699 microversion: 2.1 time: 0.197467 Apr 11 20:45:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 159/470] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:45:00 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1699 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-plugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:45:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Creating event network-vif-plugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:45:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076250 Apr 11 20:45:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 157/471] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:45:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:03 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4046a357-4f45-47ca-a4ac-eede3ffcb414 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1731 microversion: 2.1 time: 0.151047 Apr 11 20:45:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 156/472] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:45:03 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-plugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}, {"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-unplugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}, {"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:45:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Creating event network-vif-plugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:45:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Creating event network-vif-unplugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:45:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:45:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.267873 Apr 11 20:45:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 160/473] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:45:03 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:45:06 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:06 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:45:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:45:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046792 Apr 11 20:45:06 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 158/474] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:45:08 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:45:08 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:08 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:45:08 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Apr 11 20:45:08 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 157/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=5 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=9 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:19 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-936fc0cf-9858-46e0-94fd-feaf2f76bc88 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff" status: 200 len: 1494 microversion: 2.1 time: 0.279420 Apr 11 20:45:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 161/476] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:45:19 2023] GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff => generated 1494 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=5 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:33 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:33 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-52d8873c-f78a-4dac-9897-54cb2c63e833 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 200 len: 1543 microversion: 2.1 time: 0.267249 Apr 11 20:45:33 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:45:32 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 1543 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=7 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=13 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:33 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cd532b5a-0839-4454-959c-06bff35cfdc5 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1651 microversion: 2.20 time: 0.248764 Apr 11 20:45:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 158/478] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:45:33 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1651 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:40 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-15385f7b-86d6-4d5f-902c-820ad5fc9fb0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 200 len: 1488 microversion: 2.1 time: 0.183426 Apr 11 20:45:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 162/479] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:45:40 2023] GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 1488 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:45 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8e706379-a06e-43b9-b678-b00e49f188de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1534 microversion: 2.1 time: 0.143647 Apr 11 20:45:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 160/480] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:45:45 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1534 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:45:50 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:50 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:51 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:45:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-247473d6-3a6a-4e6b-a1f4-2819cf8023d8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1753 microversion: 2.87 time: 0.267698 Apr 11 20:45:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 159/481] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:45:50 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:01 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'services' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:46:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-volume_attachments/042389e0-da53-4582-ae52-c57ba7f3c396" status: 202 len: 0 microversion: 2.1 time: 0.321071 Apr 11 20:46:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 163/482] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:46:01 2023] DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-volume_attachments/042389e0-da53-4582-ae52-c57ba7f3c396 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/action" status: 202 len: 0 microversion: 2.1 time: 0.169789 Apr 11 20:46:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 161/483] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:46:03 2023] POST /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4a44272f-0ac4-46c9-a6cd-cdbc18e6d499 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1730 microversion: 2.1 time: 0.162510 Apr 11 20:46:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 160/484] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:03 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Going to try to stop instance {{(pid=61907) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 20:46:03 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action" status: 202 len: 0 microversion: 2.1 time: 0.107254 Apr 11 20:46:03 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 164/485] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:46:03 2023] POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:03 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-58f3c2a4-59d2-40dc-bfa4-55e6b0bbd438 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1663 microversion: 2.1 time: 0.161380 Apr 11 20:46:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 162/486] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:03 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:04 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-unplugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Creating event network-vif-unplugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:46:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033532 Apr 11 20:46:04 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 161/487] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-unplugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Creating event network-vif-unplugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:46:04 user devstack@n-api.service[61907]: DEBUG nova.compute.api [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61907) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:46:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100804 Apr 11 20:46:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 165/488] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:46:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027532 Apr 11 20:46:06 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 163/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:06 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:06 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:06 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:06 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:46:06 user devstack@n-api.service[61908]: DEBUG nova.compute.api [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61908) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:46:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Apr 11 20:46:06 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 162/490] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:46:14 user devstack@n-api.service[61907]: DEBUG nova.compute.api [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Instance dadac585-3a7c-40d8-a335-fc2603588c28 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61907) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:46:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052915 Apr 11 20:46:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 166/491] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:16 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:16 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:46:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038932 Apr 11 20:46:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 164/492] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1685129d-095f-4ce2-993a-cea1173d30cb", "device": "/dev/vdb"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301590 Apr 11 20:46:20 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 163/493] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:46:20 2023] POST /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-13be19b1-43d7-4514-b821-67510c15f402 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103188 Apr 11 20:46:33 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 167/494] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:46:33 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:33 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:33 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40489c9e-95df-4403-adf3-2d1ab9f2858d"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e14e2d97-2eeb-48c9-9397-a91ecbeda922 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/ips" status: 200 len: 108 microversion: 2.1 time: 0.037583 Apr 11 20:46:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 168/495] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:46:34 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Creating event network-changed:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:46:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098712 Apr 11 20:46:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 164/496] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a6c57cf-e717-411e-98df-be3d3706bc6c"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-fd1ec0db-f606-4ace-b7a9-d178cd9adc25 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.501556 Apr 11 20:46:34 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 165/497] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 20:46:33 2023] POST /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-volume_attachments => generated 188 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Invalid volume: volume 5a6c57cf-e717-411e-98df-be3d3706bc6c is already attached to instances: 645e96f7-547e-4eea-8523-7f7918c0ad3e Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:46:34 user devstack@n-api.service[61907]: request: POST /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/os-volume_attachments HTTP/1.1 Apr 11 20:46:34 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:46:34 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:46:34 user devstack@n-api.service[61907]: Connection: close Apr 11 20:46:34 user devstack@n-api.service[61907]: Content-Length: 74 Apr 11 20:46:34 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:46:34 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:46:34 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:46:34 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:46:34 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:46:34 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:46:34 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:46:34 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:46:34 user devstack@n-api.service[61907]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:46:34 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:46:34 user devstack@n-api.service[61907]: Apr 11 20:46:34 user devstack@n-api.service[61907]: {"volumeAttachment": {"volumeId": "5a6c57cf-e717-411e-98df-be3d3706bc6c"}} Apr 11 20:46:34 user devstack@n-api.service[61907]: method: > Apr 11 20:46:34 user devstack@n-api.service[61907]: exception: Invalid volume: volume 5a6c57cf-e717-411e-98df-be3d3706bc6c is already attached to instances: 645e96f7-547e-4eea-8523-7f7918c0ad3e Apr 11 20:46:34 user devstack@n-api.service[61907]: action_args: {'server_id': '5fd40faf-6ffa-40ff-b437-dd82717d9489', 'body': {'volumeAttachment': {'volumeId': '5a6c57cf-e717-411e-98df-be3d3706bc6c'}}} Apr 11 20:46:34 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5a6c57cf-e717-411e-98df-be3d3706bc6c is already attached to instances: 645e96f7-547e-4eea-8523-7f7918c0ad3e Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5a6c57cf-e717-411e-98df-be3d3706bc6c is already attached to instances: 645e96f7-547e-4eea-8523-7f7918c0ad3e Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5a6c57cf-e717-411e-98df-be3d3706bc6c is already attached to instances: 645e96f7-547e-4eea-8523-7f7918c0ad3e Apr 11 20:46:34 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 400 to user: Invalid volume: volume 5a6c57cf-e717-411e-98df-be3d3706bc6c is already attached to instances: 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:46:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-24a106ab-6059-488b-815b-6bba2078f3f7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120228 Apr 11 20:46:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 169/498] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:46:34 2023] POST /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 204 len: 0 microversion: 2.1 time: 0.124625 Apr 11 20:46:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 165/499] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:46:34 2023] DELETE /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b5771e1e-47ff-4a0e-b16a-2f400a0ea411 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 200 len: 1549 microversion: 2.1 time: 0.196554 Apr 11 20:46:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 170/500] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:34 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 1549 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-085755aa-8e79-410a-b591-b146397677c7 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-volume_attachments/40489c9e-95df-4403-adf3-2d1ab9f2858d" status: 202 len: 0 microversion: 2.20 time: 0.322160 Apr 11 20:46:34 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 166/501] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 20:46:34 2023] DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-volume_attachments/40489c9e-95df-4403-adf3-2d1ab9f2858d => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61908) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 20:46:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/action" status: 202 len: 0 microversion: 2.20 time: 0.102091 Apr 11 20:46:35 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 166/502] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:46:34 2023] POST /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "name": "network-vif-unplugged", "status": "completed", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Creating event network-vif-unplugged:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:46:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149059 Apr 11 20:46:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 167/503] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-448d1c40-9043-4c8a-b046-d7d2671fc922 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1659 microversion: 2.20 time: 0.187732 Apr 11 20:46:35 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 171/504] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:46:35 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1659 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'services' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:46:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff/os-volume_attachments/1685129d-095f-4ce2-993a-cea1173d30cb" status: 202 len: 0 microversion: 2.1 time: 0.186507 Apr 11 20:46:35 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 167/505] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:46:35 2023] DELETE /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff/os-volume_attachments/1685129d-095f-4ce2-993a-cea1173d30cb => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:46:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff" status: 204 len: 0 microversion: 2.1 time: 0.163617 Apr 11 20:46:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 168/506] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:46:35 2023] DELETE /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:35 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e9343348-e027-4749-b92d-45f61181af6a tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff" status: 200 len: 1546 microversion: 2.1 time: 0.158432 Apr 11 20:46:35 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 172/507] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:35 2023] GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "name": "network-vif-plugged", "status": "completed", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}, {"server_uuid": "5fd40faf-6ffa-40ff-b437-dd82717d9489", "name": "network-vif-deleted", "tag": "fef0930e-d810-45b5-aecc-a933e3ef8d35"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Creating event network-vif-plugged:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:46:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Creating event network-vif-deleted:fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 on user Apr 11 20:46:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029745 Apr 11 20:46:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 168/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c52ef94-8660-49a4-8105-5b63bfb187ff", "name": "network-vif-deleted", "tag": "704fb865-76f6-4e89-b6f8-b69854f4bcc6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] Creating event network-vif-deleted:704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff on user Apr 11 20:46:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Apr 11 20:46:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 169/509] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c52ef94-8660-49a4-8105-5b63bfb187ff", "name": "network-vif-unplugged", "status": "completed", "tag": "704fb865-76f6-4e89-b6f8-b69854f4bcc6"}, {"name": "network-changed", "server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}, {"server_uuid": "4c52ef94-8660-49a4-8105-5b63bfb187ff", "name": "network-vif-plugged", "status": "completed", "tag": "704fb865-76f6-4e89-b6f8-b69854f4bcc6"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Creating event network-vif-unplugged:704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff on user Apr 11 20:46:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Creating event network-changed:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:46:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Creating event network-vif-plugged:704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff on user Apr 11 20:46:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.038158 Apr 11 20:46:39 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 173/510] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:40 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9810b888-4e15-41aa-b077-02c3844f2ad7 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1503 microversion: 2.1 time: 0.150104 Apr 11 20:46:40 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 169/511] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:40 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-plugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Creating event network-vif-plugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:46:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037091 Apr 11 20:46:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 170/512] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:46 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-bf4e4d5c-0247-422b-b9b7-0f608dde3729 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1534 microversion: 2.1 time: 0.155701 Apr 11 20:46:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 174/513] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:45 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1534 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching by: {'deleted': False, 'project_id': 'cdd62a4c803247588716e71c25c62b05'} {{(pid=61908) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:46 user devstack@n-api.service[61908]: DEBUG nova.compute.multi_cell_list [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61908) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 20:46:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a24624dc-8941-427b-ac13-69eef780c329 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.063998 Apr 11 20:46:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 170/514] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 20:46:46 2023] GET /compute/v2.1/servers => generated 340 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:46 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f62bcedc-2f80-49d3-8789-063fd7751ede tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1534 microversion: 2.1 time: 0.161752 Apr 11 20:46:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 171/515] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:46 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1534 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:46 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-plugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Creating event network-vif-plugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:46:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037107 Apr 11 20:46:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 175/516] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:48 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299270 Apr 11 20:46:48 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 171/517] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:46:47 2023] POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390/action" status: 202 len: 0 microversion: 2.87 time: 0.093477 Apr 11 20:46:51 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 172/518] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:46:51 2023] POST /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:51 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:51 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-94922480-4fe6-4bf5-b9eb-ce1f1004ab36 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1761 microversion: 2.87 time: 0.260331 Apr 11 20:46:51 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 176/519] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:46:51 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1761 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:46:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-unplugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Creating event network-vif-unplugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:46:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037067 Apr 11 20:46:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 172/520] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:53 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e7d5e595-f08c-4f4f-927b-0b6dd64cf84f tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1723 microversion: 2.1 time: 0.161960 Apr 11 20:46:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 173/521] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:53 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:54 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-df66a0ee-4a25-4493-937b-fe1c8d95d8b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1640 microversion: 2.1 time: 0.193843 Apr 11 20:46:54 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 177/522] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:54 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1640 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}, {"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:46:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:46:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029050 Apr 11 20:46:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 173/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:55 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-eaf19133-0535-488b-bd54-fa2fa5cf7274 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1580 microversion: 2.1 time: 0.139104 Apr 11 20:46:55 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 174/524] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:55 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1580 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:46:56 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:56 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:46:56 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Apr 11 20:46:56 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 178/525] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:58 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:58 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Creating event network-changed:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:46:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032918 Apr 11 20:46:58 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 174/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:46:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-220540250"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=7,nova_cell1:UPDATE=11 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:46:59 user devstack@n-api.service[61909]: INFO nova.network.security_group_api [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Adding security group df463111-a437-4720-a2a1-eed8522cd3f1 to port 91830629-fa39-4a76-9eba-4b33f2f66b7a Apr 11 20:46:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-53eddec6-4de7-49e3-b921-cab692eabb40 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/action" status: 202 len: 0 microversion: 2.1 time: 0.564116 Apr 11 20:46:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 175/527] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:46:59 2023] POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:46:59 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:46:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9ffaa4b4-41d1-4f9a-84e5-57200b441e8b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1745 microversion: 2.1 time: 0.156530 Apr 11 20:46:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 179/528] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:46:59 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/action" status: 202 len: 0 microversion: 2.1 time: 0.092077 Apr 11 20:47:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 175/529] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:47:00 2023] POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:00 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-32027fde-4fcc-4fa4-b609-f0b3fb921fd9 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1737 microversion: 2.1 time: 0.161567 Apr 11 20:47:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 176/530] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:00 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:00 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Creating event network-changed:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:47:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029417 Apr 11 20:47:00 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 180/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-unplugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Creating event network-vif-unplugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:47:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035426 Apr 11 20:47:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 176/532] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-plugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:05 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Creating event network-vif-plugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:47:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039908 Apr 11 20:47:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 177/533] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-plugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}, {"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-plugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=31 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=65 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Creating event network-vif-plugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:47:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Creating event network-vif-plugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:47:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036952 Apr 11 20:47:07 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 181/534] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:47:24 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 HTTP/1.1 Apr 11 20:47:24 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:47:24 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:47:24 user devstack@n-api.service[61908]: Connection: close Apr 11 20:47:24 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:47:24 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:47:24 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:47:24 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:47:24 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:47:24 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:47:24 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:47:24 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:47:24 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:47:24 user devstack@n-api.service[61908]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:47:24 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:47:24 user devstack@n-api.service[61908]: method: > Apr 11 20:47:24 user devstack@n-api.service[61908]: exception: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:47:24 user devstack@n-api.service[61908]: action_args: {'id': '5fd40faf-6ffa-40ff-b437-dd82717d9489'} Apr 11 20:47:24 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:47:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:47:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:47:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e471b28b-1086-4cd1-9b08-8f4612706f86 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 404 len: 111 microversion: 2.1 time: 0.040621 Apr 11 20:47:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 177/535] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:24 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:47:24 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=9 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:24 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e188c66c-e55d-482e-8560-122177f61b88 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '.version_select at 0x7f726839e4d0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:24 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e188c66c-e55d-482e-8560-122177f61b88 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283781213" status: 202 len: 0 microversion: 2.1 time: 0.027133 Apr 11 20:47:24 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 178/536] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 20:47:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283781213 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-eb98ef8c-a9e1-4df0-96a5-4f8654c3793f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1704 microversion: 2.20 time: 0.153748 Apr 11 20:47:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 182/537] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:47:25 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1704 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'services' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:47:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments/5a6c57cf-e717-411e-98df-be3d3706bc6c" status: 202 len: 0 microversion: 2.1 time: 0.162834 Apr 11 20:47:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 178/538] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:47:25 2023] DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments/5a6c57cf-e717-411e-98df-be3d3706bc6c => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d46a206e-e26c-4452-8bbb-e052e655d2c3 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050958 Apr 11 20:47:25 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 179/539] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:47:25 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] HTTP exception thrown: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Request method failure captured: Apr 11 20:47:25 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff HTTP/1.1 Apr 11 20:47:25 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:47:25 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:47:25 user devstack@n-api.service[61907]: Connection: close Apr 11 20:47:25 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:47:25 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:47:25 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:47:25 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:47:25 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcaoU9Fzq8DmRPasWAxeDHSKM-6yJxCJ5TAlbl427nHY2bH_EXC3ZTjNNZCg2dqkgdtsoUXAmQRibvXti-j_ZKzC32KnCpUmyaITY3sNsXAGT9aq8GHkQZsRymk1u71ZHW6iSw5sFtZm-63GKVGnnPu1_VsrWluAIW-vwGZJhFhy7Qs Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Project-Id: 1982dc9f62644e2b8a541dc25854a6a9 Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Project-Name: tempest-VolumesSnapshotTestJSON-323644922 Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1982dc9f62644e2b8a541dc25854a6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1982dc9f62644e2b8a541dc25854a6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1982dc9f62644e2b8a541dc25854a6a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Tenant: tempest-VolumesSnapshotTestJSON-323644922 Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Tenant-Id: 1982dc9f62644e2b8a541dc25854a6a9 Apr 11 20:47:25 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-323644922 Apr 11 20:47:25 user devstack@n-api.service[61907]: X-User: tempest-VolumesSnapshotTestJSON-323644922-project-member Apr 11 20:47:25 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:47:25 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:47:25 user devstack@n-api.service[61907]: X-User-Id: 94e4de8a85394d258268ff4304eccb2d Apr 11 20:47:25 user devstack@n-api.service[61907]: X-User-Name: tempest-VolumesSnapshotTestJSON-323644922-project-member Apr 11 20:47:25 user devstack@n-api.service[61907]: method: > Apr 11 20:47:25 user devstack@n-api.service[61907]: exception: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. Apr 11 20:47:25 user devstack@n-api.service[61907]: action_args: {'id': '4c52ef94-8660-49a4-8105-5b63bfb187ff'} Apr 11 20:47:25 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. Apr 11 20:47:25 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:47:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Returning 404 to user: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:47:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-fcef4dcb-854a-4917-a82e-101790c2d548 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff" status: 404 len: 111 microversion: 2.1 time: 0.028082 Apr 11 20:47:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 183/540] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:25 2023] GET /compute/v2.1/servers/4c52ef94-8660-49a4-8105-5b63bfb187ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:47:30 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1075804271", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "5986aa1d-df23-4d2b-9e22-0030e7716fd4"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] validate_networks() for [('5986aa1d-df23-4d2b-9e22-0030e7716fd4', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting quotas for project 1982dc9f62644e2b8a541dc25854a6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting quotas for user 94e4de8a85394d258268ff4304eccb2d and project 1982dc9f62644e2b8a541dc25854a6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:47:31 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:47:31 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.515584 Apr 11 20:47:31 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 179/541] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:47:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:47:31 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-9761da1a-1a20-49dd-9c73-7b1f56a8b4f3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:31 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-9761da1a-1a20-49dd-9c73-7b1f56a8b4f3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:31 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-9761da1a-1a20-49dd-9c73-7b1f56a8b4f3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:31 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-9761da1a-1a20-49dd-9c73-7b1f56a8b4f3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c" status: 200 len: 1213 microversion: 2.1 time: 0.101794 Apr 11 20:47:31 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 180/542] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:31 2023] GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd1ff89-55fd-454d-a98f-2cab0388b86c", "tag": "bd8a4a43-cc71-449b-8730-83aae6973e7f"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Creating event network-changed:bd8a4a43-cc71-449b-8730-83aae6973e7f for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c on user Apr 11 20:47:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 Apr 11 20:47:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 184/543] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:36 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd1ff89-55fd-454d-a98f-2cab0388b86c", "name": "network-vif-plugged", "status": "completed", "tag": "bd8a4a43-cc71-449b-8730-83aae6973e7f"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Creating event network-vif-plugged:bd8a4a43-cc71-449b-8730-83aae6973e7f for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c on user Apr 11 20:47:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Apr 11 20:47:36 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 180/544] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd1ff89-55fd-454d-a98f-2cab0388b86c", "name": "network-vif-plugged", "status": "completed", "tag": "bd8a4a43-cc71-449b-8730-83aae6973e7f"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:38 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Creating event network-vif-plugged:bd8a4a43-cc71-449b-8730-83aae6973e7f for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c on user Apr 11 20:47:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036666 Apr 11 20:47:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 181/545] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-fc85e258-4b47-4f81-aab6-a5de707195d5 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1767 microversion: 2.87 time: 0.197218 Apr 11 20:47:41 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 185/546] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:47:41 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1767 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:42 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:47:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/action" status: 200 len: 32 microversion: 2.1 time: 0.118934 Apr 11 20:47:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 181/547] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:47:42 2023] POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:42 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:42 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e1d57450-c44e-44e4-aa6e-b51b936e8d14 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1509 microversion: 2.1 time: 0.173244 Apr 11 20:47:42 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 182/548] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:42 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:43 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-unplugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Creating event network-vif-unplugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:47:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043035 Apr 11 20:47:43 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 186/549] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:47:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:47:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031079 Apr 11 20:47:45 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 182/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}, {"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:47:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:47:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028293 Apr 11 20:47:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 183/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:50 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-f4f5657b-4b58-435a-acb0-f09a52932b52 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1745 microversion: 2.1 time: 0.213375 Apr 11 20:47:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 187/552] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:50 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-05ae4600-7f4d-42a4-952a-6fa1df2ed5fd tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1723 microversion: 2.1 time: 0.164929 Apr 11 20:47:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 183/553] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:53 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:54 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:54 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-59a16e2e-2972-4626-8337-b9e07f906a98 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1723 microversion: 2.1 time: 0.171827 Apr 11 20:47:54 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 184/554] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:54 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:54 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Going to try to start instance {{(pid=61907) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 20:47:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action" status: 202 len: 0 microversion: 2.1 time: 0.070366 Apr 11 20:47:54 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 188/555] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:47:54 2023] POST /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:54 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:47:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-79dd9e43-32e5-457d-ade0-9502026b53c8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1649 microversion: 2.1 time: 0.233734 Apr 11 20:47:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 184/556] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:47:54 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1649 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:47:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:57 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:47:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069787 Apr 11 20:47:57 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 185/557] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:47:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:47:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=17 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:47:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:47:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:47:59 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:47:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:47:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034640 Apr 11 20:47:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 189/558] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e0c3d4b7-d3b6-4e1b-9691-3b6c30870006 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098153 Apr 11 20:48:16 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 185/559] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:48:15 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=18 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:48:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 204 len: 0 microversion: 2.1 time: 0.143450 Apr 11 20:48:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 186/560] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:48:16 2023] DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "name": "network-vif-unplugged", "status": "completed", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:16 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:16 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Creating event network-vif-unplugged:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:48:16 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026841 Apr 11 20:48:16 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 186/561] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0e99da06-a516-4660-83e8-9756c9628d4f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 200 len: 1665 microversion: 2.1 time: 0.313161 Apr 11 20:48:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 190/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:48:16 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 1665 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:48:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "name": "network-vif-deleted", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] Creating event network-vif-deleted:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:48:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033164 Apr 11 20:48:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 187/563] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645e96f7-547e-4eea-8523-7f7918c0ad3e", "name": "network-vif-plugged", "status": "completed", "tag": "7e936873-bcfe-497e-b850-374d6ae930a6"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Creating event network-vif-plugged:7e936873-bcfe-497e-b850-374d6ae930a6 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e on user Apr 11 20:48:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Apr 11 20:48:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 187/564] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:21 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-7b64b20f-659c-442f-a384-4fa5867247a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c" status: 200 len: 1495 microversion: 2.1 time: 0.152589 Apr 11 20:48:21 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 191/565] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:48:21 2023] GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8822b9db-0674-4088-bced-0af4331ca420 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044472 Apr 11 20:48:25 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 188/566] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 20:48:25 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:48:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 204 len: 0 microversion: 2.20 time: 0.122163 Apr 11 20:48:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 188/567] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:48:25 2023] DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0a8e2484-5bf1-451f-994c-0d9292ef6a75 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 200 len: 1710 microversion: 2.20 time: 0.180020 Apr 11 20:48:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 192/568] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:48:25 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:48:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-unplugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Creating event network-vif-unplugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:48:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035375 Apr 11 20:48:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 189/569] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:27 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-deleted", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] Creating event network-vif-deleted:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:48:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Apr 11 20:48:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 189/570] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:28 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4", "name": "network-vif-plugged", "status": "completed", "tag": "70b946a4-0951-4e8c-adc6-ac21f5837691"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Creating event network-vif-plugged:70b946a4-0951-4e8c-adc6-ac21f5837691 for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 on user Apr 11 20:48:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028388 Apr 11 20:48:28 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 193/571] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:32 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0abeabe3-ed23-4c2e-b414-67ccb0763a7c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1489 microversion: 2.1 time: 0.354183 Apr 11 20:48:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 190/572] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:48:32 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1489 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-88977129", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] validate_networks() for [('6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for user 1d5cb62cc3844248be2e4456d970ccdf and project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:48:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:48:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.628796 Apr 11 20:48:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 190/573] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:48:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=21 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-783fe026-d081-41b2-a9ec-fc9341b14c57 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-783fe026-d081-41b2-a9ec-fc9341b14c57 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-783fe026-d081-41b2-a9ec-fc9341b14c57 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-783fe026-d081-41b2-a9ec-fc9341b14c57 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:42 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-783fe026-d081-41b2-a9ec-fc9341b14c57 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-783fe026-d081-41b2-a9ec-fc9341b14c57 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" status: 200 len: 1393 microversion: 2.87 time: 0.089242 Apr 11 20:48:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 194/574] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:48:42 2023] GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => generated 1393 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:44 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f9888592-3819-47fb-9db2-cf1fac2bbc3f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1653 microversion: 2.1 time: 0.165064 Apr 11 20:48:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 191/575] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:48:44 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1653 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:48:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3", "tag": "81b40e8f-efea-4c1a-8153-999d8b566b81"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Creating event network-changed:81b40e8f-efea-4c1a-8153-999d8b566b81 for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 on user Apr 11 20:48:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069804 Apr 11 20:48:45 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 191/576] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3", "name": "network-vif-plugged", "status": "completed", "tag": "81b40e8f-efea-4c1a-8153-999d8b566b81"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Creating event network-vif-plugged:81b40e8f-efea-4c1a-8153-999d8b566b81 for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 on user Apr 11 20:48:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Apr 11 20:48:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 195/577] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:49 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3", "name": "network-vif-plugged", "status": "completed", "tag": "81b40e8f-efea-4c1a-8153-999d8b566b81"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Creating event network-vif-plugged:81b40e8f-efea-4c1a-8153-999d8b566b81 for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 on user Apr 11 20:48:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039832 Apr 11 20:48:49 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 192/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-220540250"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:50 user devstack@n-api.service[61908]: INFO nova.network.security_group_api [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Removing security group df463111-a437-4720-a2a1-eed8522cd3f1 from port 91830629-fa39-4a76-9eba-4b33f2f66b7a Apr 11 20:48:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-855dde37-e69f-4579-9bf6-dd258217967e tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/action" status: 202 len: 0 microversion: 2.1 time: 0.679718 Apr 11 20:48:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 192/579] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:48:50 2023] POST /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:48:51 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:51 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:51 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Creating event network-changed:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:48:51 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030363 Apr 11 20:48:51 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 196/580] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Creating event network-changed:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:48:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034054 Apr 11 20:48:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 193/581] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:52 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'services' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:48:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments/dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb" status: 202 len: 0 microversion: 2.1 time: 0.196831 Apr 11 20:48:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 193/582] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:48:52 2023] DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments/dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-662693be-e56a-49a2-88ca-15ede20833de tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058542 Apr 11 20:48:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 197/583] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:48:52 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:54 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:48:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 204 len: 0 microversion: 2.1 time: 0.149014 Apr 11 20:48:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:48:54 2023] DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:54 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:48:54 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5a4c0210-4b17-407d-bd44-5b9102f3fd82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 200 len: 1729 microversion: 2.1 time: 0.244522 Apr 11 20:48:54 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 194/585] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:48:54 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:48:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-unplugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:54 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:48:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:54 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Creating event network-vif-unplugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:48:54 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032607 Apr 11 20:48:54 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 198/586] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:48:56 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-plugged", "status": "completed", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}, {"server_uuid": "dadac585-3a7c-40d8-a335-fc2603588c28", "name": "network-vif-deleted", "tag": "21864ca9-0ae0-4591-a5bc-fac2428743cb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:48:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:48:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:48:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:48:56 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Creating event network-vif-plugged:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:48:56 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Creating event network-vif-deleted:21864ca9-0ae0-4591-a5bc-fac2428743cb for instance dadac585-3a7c-40d8-a335-fc2603588c28 on user Apr 11 20:48:56 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036129 Apr 11 20:48:56 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 195/587] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:48:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:49:06 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e HTTP/1.1 Apr 11 20:49:06 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:49:06 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:49:06 user devstack@n-api.service[61909]: Connection: close Apr 11 20:49:06 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:49:06 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:49:06 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:49:06 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:49:06 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:49:06 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:49:06 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:49:06 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:49:06 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:49:06 user devstack@n-api.service[61909]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:49:06 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:49:06 user devstack@n-api.service[61909]: method: > Apr 11 20:49:06 user devstack@n-api.service[61909]: exception: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:49:06 user devstack@n-api.service[61909]: action_args: {'id': '645e96f7-547e-4eea-8523-7f7918c0ad3e'} Apr 11 20:49:06 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:49:06 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-581bcd2b-5aed-4c10-ad7f-95dcaa22bba4 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 404 len: 111 microversion: 2.1 time: 0.036418 Apr 11 20:49:06 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 195/588] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:06 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:49:06 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=14 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:06 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=12 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:06 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-60b1b83b-ffcb-4dbb-a2bc-52df4cdbea12 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '.version_select at 0x7f72683c6e60>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-60b1b83b-ffcb-4dbb-a2bc-52df4cdbea12 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668966515" status: 202 len: 0 microversion: 2.1 time: 0.028426 Apr 11 20:49:06 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 199/589] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:49:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668966515 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:49:07 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:07 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:07 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3d51324d-4b57-4b28-96a8-707704a52153 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: .version_select at 0x7f726836a4d0>, body: {"keypair": {"name": "tempest-keypair-319392662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxqGSOT+nC8Y5GLekTT28NQqXKel5w/Nz8b0qa2ChUKgQlp/lJfRSaBMsnLRITHJ7B9e5AlqpL4GODcIHuKjxLf1m6dEsavIrti/LprkMSPYiA5nDdzyNhxE5IcGNkciQ=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:07 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-3d51324d-4b57-4b28-96a8-707704a52153 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:49:07 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-3d51324d-4b57-4b28-96a8-707704a52153 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:49:07 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3d51324d-4b57-4b28-96a8-707704a52153 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069288 Apr 11 20:49:07 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 196/590] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:49:07 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:08 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-231989771", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0"}], "security_groups": [{"name": "tempest-securitygroup--567772245"}], "key_name": "tempest-keypair-319392662", "user_data": "}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:08 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] validate_networks() for [('2e7f3602-ac71-4117-82aa-d6e25c53d5d0', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:49:09 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:49:09 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.630617 Apr 11 20:49:09 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 196/591] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:49:08 2023] POST /compute/v2.1/servers => generated 399 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 20:49:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ca60c5b2-efb8-44c5-a94a-aea912a048ec tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:09 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ca60c5b2-efb8-44c5-a94a-aea912a048ec tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:09 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ca60c5b2-efb8-44c5-a94a-aea912a048ec tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ca60c5b2-efb8-44c5-a94a-aea912a048ec tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 200 len: 1234 microversion: 2.1 time: 0.071656 Apr 11 20:49:09 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 200/592] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:09 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 1234 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:49:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:11 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Creating event network-changed:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:49:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032556 Apr 11 20:49:11 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 197/593] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "name": "network-vif-plugged", "status": "completed", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Creating event network-vif-plugged:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:49:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036721 Apr 11 20:49:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 197/594] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:15 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "name": "network-vif-plugged", "status": "completed", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Creating event network-vif-plugged:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:49:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034579 Apr 11 20:49:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 201/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:16 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HTTP exception thrown: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Request method failure captured: Apr 11 20:49:16 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 HTTP/1.1 Apr 11 20:49:16 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:49:16 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:49:16 user devstack@n-api.service[61908]: Connection: close Apr 11 20:49:16 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:49:16 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:49:16 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:49:16 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:49:16 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSGTaRVHUu5CiHmz8Fc3-VT3tP1y_11C1pMO47q6lKUfkhUI4Bq6OPT2UOzhJujXc5-1V5blLhmxGk1LcTaZ2_Jwk03qy0we6SHzLLX8nH_ld1XQLERH0vPAcLPX-fZFfF5X3yFxL58nouG-WjtndR6t8Nu2cjv8cM1EBKLaxAa7N4 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Project-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Tenant-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:16 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:16 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:49:16 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:49:16 user devstack@n-api.service[61908]: X-User-Id: f82468d207064eb288a2c8a167cd7d9d Apr 11 20:49:16 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:16 user devstack@n-api.service[61908]: method: > Apr 11 20:49:16 user devstack@n-api.service[61908]: exception: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:16 user devstack@n-api.service[61908]: action_args: {'id': '4ad985d5-6fd0-48f3-be8f-00a7fc4791c4'} Apr 11 20:49:16 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:16 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Returning 404 to user: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:16 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d991a6c6-2698-40af-be67-c2c15a49ab1a tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 404 len: 111 microversion: 2.20 time: 0.033219 Apr 11 20:49:16 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 198/596] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:49:16 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:49:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-9ee96815-7f50-47be-8417-e35ab1689753 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '.version_select at 0x7f726839f520>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-9ee96815-7f50-47be-8417-e35ab1689753 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545600492" status: 204 len: 0 microversion: 2.20 time: 0.032862 Apr 11 20:49:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 198/597] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 20:49:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545600492 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HTTP exception thrown: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Request method failure captured: Apr 11 20:49:18 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 HTTP/1.1 Apr 11 20:49:18 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:49:18 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:49:18 user devstack@n-api.service[61907]: Connection: close Apr 11 20:49:18 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:49:18 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:49:18 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:49:18 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:49:18 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSGTaRVHUu5CiHmz8Fc3-VT3tP1y_11C1pMO47q6lKUfkhUI4Bq6OPT2UOzhJujXc5-1V5blLhmxGk1LcTaZ2_Jwk03qy0we6SHzLLX8nH_ld1XQLERH0vPAcLPX-fZFfF5X3yFxL58nouG-WjtndR6t8Nu2cjv8cM1EBKLaxAa7N4 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Project-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Tenant-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:18 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:18 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:49:18 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:49:18 user devstack@n-api.service[61907]: X-User-Id: f82468d207064eb288a2c8a167cd7d9d Apr 11 20:49:18 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:18 user devstack@n-api.service[61907]: method: > Apr 11 20:49:18 user devstack@n-api.service[61907]: exception: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61907]: action_args: {'id': '4ad985d5-6fd0-48f3-be8f-00a7fc4791c4'} Apr 11 20:49:18 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Returning 404 to user: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b850a80c-7c1e-42c6-86c1-3267e78f30bc tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 404 len: 111 microversion: 2.20 time: 0.038299 Apr 11 20:49:18 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 202/598] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:49:18 2023] DELETE /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HTTP exception thrown: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Request method failure captured: Apr 11 20:49:18 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 HTTP/1.1 Apr 11 20:49:18 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:49:18 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:49:18 user devstack@n-api.service[61908]: Connection: close Apr 11 20:49:18 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:49:18 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:49:18 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:49:18 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:49:18 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSGTaRVHUu5CiHmz8Fc3-VT3tP1y_11C1pMO47q6lKUfkhUI4Bq6OPT2UOzhJujXc5-1V5blLhmxGk1LcTaZ2_Jwk03qy0we6SHzLLX8nH_ld1XQLERH0vPAcLPX-fZFfF5X3yFxL58nouG-WjtndR6t8Nu2cjv8cM1EBKLaxAa7N4 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Project-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Tenant-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:18 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:18 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:49:18 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:49:18 user devstack@n-api.service[61908]: X-User-Id: f82468d207064eb288a2c8a167cd7d9d Apr 11 20:49:18 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:18 user devstack@n-api.service[61908]: method: > Apr 11 20:49:18 user devstack@n-api.service[61908]: exception: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61908]: action_args: {'id': '4ad985d5-6fd0-48f3-be8f-00a7fc4791c4'} Apr 11 20:49:18 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. Apr 11 20:49:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Returning 404 to user: Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-401ad608-dde3-44df-9c52-348b764ae1f1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" status: 404 len: 111 microversion: 2.20 time: 0.046763 Apr 11 20:49:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 199/599] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:49:18 2023] GET /compute/v2.1/servers/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HTTP exception thrown: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Request method failure captured: Apr 11 20:49:19 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 HTTP/1.1 Apr 11 20:49:19 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:49:19 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:49:19 user devstack@n-api.service[61909]: Connection: close Apr 11 20:49:19 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:49:19 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:49:19 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:49:19 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:49:19 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSGTaRVHUu5CiHmz8Fc3-VT3tP1y_11C1pMO47q6lKUfkhUI4Bq6OPT2UOzhJujXc5-1V5blLhmxGk1LcTaZ2_Jwk03qy0we6SHzLLX8nH_ld1XQLERH0vPAcLPX-fZFfF5X3yFxL58nouG-WjtndR6t8Nu2cjv8cM1EBKLaxAa7N4 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Project-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Tenant-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:19 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:19 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:49:19 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:49:19 user devstack@n-api.service[61909]: X-User-Id: f82468d207064eb288a2c8a167cd7d9d Apr 11 20:49:19 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:19 user devstack@n-api.service[61909]: method: > Apr 11 20:49:19 user devstack@n-api.service[61909]: exception: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61909]: action_args: {'id': '534b82fe-0c07-46dd-bb21-66ad7f6b1397'} Apr 11 20:49:19 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Returning 404 to user: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-45da7da2-23c0-4dc4-9b37-d950cec22305 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 404 len: 111 microversion: 2.20 time: 0.035629 Apr 11 20:49:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 199/600] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:49:19 2023] DELETE /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HTTP exception thrown: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Request method failure captured: Apr 11 20:49:19 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 HTTP/1.1 Apr 11 20:49:19 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:49:19 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:49:19 user devstack@n-api.service[61907]: Connection: close Apr 11 20:49:19 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:49:19 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:49:19 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:49:19 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:49:19 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSGTaRVHUu5CiHmz8Fc3-VT3tP1y_11C1pMO47q6lKUfkhUI4Bq6OPT2UOzhJujXc5-1V5blLhmxGk1LcTaZ2_Jwk03qy0we6SHzLLX8nH_ld1XQLERH0vPAcLPX-fZFfF5X3yFxL58nouG-WjtndR6t8Nu2cjv8cM1EBKLaxAa7N4 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Project-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5fce55f8224068805593f94d5f2d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Tenant-Id: 0d5fce55f8224068805593f94d5f2d36 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426216861 Apr 11 20:49:19 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:19 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:49:19 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:49:19 user devstack@n-api.service[61907]: X-User-Id: f82468d207064eb288a2c8a167cd7d9d Apr 11 20:49:19 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426216861-project-member Apr 11 20:49:19 user devstack@n-api.service[61907]: method: > Apr 11 20:49:19 user devstack@n-api.service[61907]: exception: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61907]: action_args: {'id': '534b82fe-0c07-46dd-bb21-66ad7f6b1397'} Apr 11 20:49:19 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. Apr 11 20:49:19 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Returning 404 to user: Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-fe430a3d-943f-40cb-ba56-42fc8bd6bc27 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397" status: 404 len: 111 microversion: 2.20 time: 0.040994 Apr 11 20:49:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 203/601] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:49:19 2023] GET /compute/v2.1/servers/534b82fe-0c07-46dd-bb21-66ad7f6b1397 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1423fa0c-764d-4182-9bb0-e045da6bfb1a", "device": "/dev/vdb"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693167 Apr 11 20:49:22 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 200/602] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:49:21 2023] POST /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d12438-3e42-4810-a296-06607dc53b0d"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 05f0405b-e73d-4c84-8208-21194ab434d2 while it is in vm_state rescued Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Request method failure captured: Apr 11 20:49:32 user devstack@n-api.service[61907]: request: POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/os-volume_attachments HTTP/1.1 Apr 11 20:49:32 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:49:32 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:49:32 user devstack@n-api.service[61907]: Connection: close Apr 11 20:49:32 user devstack@n-api.service[61907]: Content-Length: 74 Apr 11 20:49:32 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:49:32 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:49:32 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:49:32 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcZSFywGtwJwYWSkzx5Gu9ZYHnLHdOXo1DNiv8vMNmEPyDgdsGLfmPIBeHsa2fgNAuc5nMTC0wW4-67tbmU65_7sBh0J9OzjPA4a4B2gzdd5SyQszzI2yIgn9ii0IwH-EIN-fs7kCme2FERA5Ygy969w_kI_LeivqlfbVMbY3VHDiOk Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Project-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Tenant-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-User: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:49:32 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:49:32 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:49:32 user devstack@n-api.service[61907]: X-User-Id: dce0b6fa6d9546c8a04b7a4a5f93e0c7 Apr 11 20:49:32 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:49:32 user devstack@n-api.service[61907]: Apr 11 20:49:32 user devstack@n-api.service[61907]: {"volumeAttachment": {"volumeId": "98d12438-3e42-4810-a296-06607dc53b0d"}} Apr 11 20:49:32 user devstack@n-api.service[61907]: method: > Apr 11 20:49:32 user devstack@n-api.service[61907]: exception: Cannot 'attach_volume' instance 05f0405b-e73d-4c84-8208-21194ab434d2 while it is in vm_state rescued Apr 11 20:49:32 user devstack@n-api.service[61907]: action_args: {'server_id': '05f0405b-e73d-4c84-8208-21194ab434d2', 'body': {'volumeAttachment': {'volumeId': '98d12438-3e42-4810-a296-06607dc53b0d'}}} Apr 11 20:49:32 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 05f0405b-e73d-4c84-8208-21194ab434d2 while it is in vm_state rescued Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 05f0405b-e73d-4c84-8208-21194ab434d2 while it is in vm_state rescued Apr 11 20:49:32 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Returning 409 to user: Cannot 'attach_volume' instance 05f0405b-e73d-4c84-8208-21194ab434d2 while it is in vm_state rescued {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-09b7fefd-a362-495d-b3e5-bed6a8e591d9 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058311 Apr 11 20:49:32 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 204/603] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:49:32 2023] POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 20:49:32 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:32 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/action" status: 202 len: 0 microversion: 2.1 time: 0.091299 Apr 11 20:49:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 201/604] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:49:32 2023] POST /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:33 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:33 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:33 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:33 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5befdc32-cd7a-4bd1-8586-00dd2bc3223a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" status: 200 len: 1689 microversion: 2.87 time: 0.215034 Apr 11 20:49:33 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 200/605] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:49:32 2023] GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:49:33 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-bfd75dec-a7e5-469c-8edc-f23d554815f2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1497 microversion: 2.1 time: 0.322728 Apr 11 20:49:33 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 205/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:33 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:49:33 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-unplugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Creating event network-vif-unplugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:49:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041957 Apr 11 20:49:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 202/607] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}, {"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:49:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:49:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034536 Apr 11 20:49:36 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 201/608] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'services' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:49:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c/os-volume_attachments/1423fa0c-764d-4182-9bb0-e045da6bfb1a" status: 202 len: 0 microversion: 2.1 time: 0.167960 Apr 11 20:49:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 206/609] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:49:36 2023] DELETE /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c/os-volume_attachments/1423fa0c-764d-4182-9bb0-e045da6bfb1a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:49:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c" status: 204 len: 0 microversion: 2.1 time: 0.119459 Apr 11 20:49:36 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 203/610] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:49:36 2023] DELETE /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:36 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ba723765-5415-4f9a-b7e4-8bc694e4aa48 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c" status: 200 len: 1547 microversion: 2.1 time: 0.160687 Apr 11 20:49:36 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 202/611] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:36 2023] GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:49:38 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:49:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029773 Apr 11 20:49:38 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 207/612] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd1ff89-55fd-454d-a98f-2cab0388b86c", "name": "network-vif-unplugged", "status": "completed", "tag": "bd8a4a43-cc71-449b-8730-83aae6973e7f"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Creating event network-vif-unplugged:bd8a4a43-cc71-449b-8730-83aae6973e7f for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c on user Apr 11 20:49:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037173 Apr 11 20:49:38 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 204/613] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd1ff89-55fd-454d-a98f-2cab0388b86c", "name": "network-vif-plugged", "status": "completed", "tag": "bd8a4a43-cc71-449b-8730-83aae6973e7f"}, {"server_uuid": "dfd1ff89-55fd-454d-a98f-2cab0388b86c", "name": "network-vif-deleted", "tag": "bd8a4a43-cc71-449b-8730-83aae6973e7f"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:40 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Creating event network-vif-plugged:bd8a4a43-cc71-449b-8730-83aae6973e7f for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c on user Apr 11 20:49:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Creating event network-vif-deleted:bd8a4a43-cc71-449b-8730-83aae6973e7f for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c on user Apr 11 20:49:40 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031480 Apr 11 20:49:40 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 203/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:42 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-419bfdb1-0f7f-4e59-9ca1-11915339dd4b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050274 Apr 11 20:49:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 208/615] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:49:42 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HTTP exception thrown: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 is not attached to volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Request method failure captured: Apr 11 20:49:42 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments/dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb HTTP/1.1 Apr 11 20:49:42 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:49:42 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:49:42 user devstack@n-api.service[61908]: Connection: close Apr 11 20:49:42 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:49:42 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:49:42 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:49:42 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:49:42 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcViOlS8LEd3QPJ88kbES3EiCucmL9xwWjHlXB3MG3neyqH9atP2HhcjcxQSr95ePAyf4DWYqmmMOtk61u9xz3FaOSiCJ1ES-6kqjo4shptrKTUJ1pM_9KjZS6ml3Vp88SetSH0-n3wgcnfFQx_MxqenK8Bjs9S9qUgR-JFKyG6Wut4 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Project-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Tenant: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Tenant-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:49:42 user devstack@n-api.service[61908]: X-User: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:49:42 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:49:42 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:49:42 user devstack@n-api.service[61908]: X-User-Id: 0a70ed7ce13442e6b7f6f62b960520ad Apr 11 20:49:42 user devstack@n-api.service[61908]: X-User-Name: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:49:42 user devstack@n-api.service[61908]: method: > Apr 11 20:49:42 user devstack@n-api.service[61908]: exception: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 is not attached to volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb Apr 11 20:49:42 user devstack@n-api.service[61908]: action_args: {'server_id': '0d4bccf7-341f-4bc4-ade1-cb948f6dd950', 'id': 'dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb'} Apr 11 20:49:42 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb. Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 is not attached to volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 is not attached to volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb Apr 11 20:49:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Returning 404 to user: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 is not attached to volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9e61f2b0-a844-4684-94ee-0a0a03bf882b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments/dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb" status: 404 len: 154 microversion: 2.1 time: 0.095810 Apr 11 20:49:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 205/616] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:49:42 2023] DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/os-volume_attachments/dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:49:44 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 HTTP/1.1 Apr 11 20:49:44 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:49:44 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:49:44 user devstack@n-api.service[61909]: Connection: close Apr 11 20:49:44 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:49:44 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:49:44 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:49:44 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:49:44 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:49:44 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61909]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:49:44 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:49:44 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:49:44 user devstack@n-api.service[61909]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:49:44 user devstack@n-api.service[61909]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:49:44 user devstack@n-api.service[61909]: method: > Apr 11 20:49:44 user devstack@n-api.service[61909]: exception: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61909]: action_args: {'id': 'dadac585-3a7c-40d8-a335-fc2603588c28'} Apr 11 20:49:44 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b5af7aed-8017-4827-a9c8-d666dae4df0b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 404 len: 111 microversion: 2.1 time: 0.072596 Apr 11 20:49:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 204/617] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:44 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:49:44 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments HTTP/1.1 Apr 11 20:49:44 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:49:44 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:49:44 user devstack@n-api.service[61907]: Connection: close Apr 11 20:49:44 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:49:44 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:49:44 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:49:44 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:49:44 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:49:44 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61907]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:49:44 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:49:44 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:49:44 user devstack@n-api.service[61907]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:49:44 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:49:44 user devstack@n-api.service[61907]: method: > Apr 11 20:49:44 user devstack@n-api.service[61907]: exception: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61907]: action_args: {'server_id': 'dadac585-3a7c-40d8-a335-fc2603588c28'} Apr 11 20:49:44 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-17081f9c-fc4f-4f75-8296-17a0602a5578 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029054 Apr 11 20:49:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 209/618] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:49:44 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:44 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:49:44 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 HTTP/1.1 Apr 11 20:49:44 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:49:44 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:49:44 user devstack@n-api.service[61908]: Connection: close Apr 11 20:49:44 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:49:44 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:49:44 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:49:44 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:49:44 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:49:44 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:49:44 user devstack@n-api.service[61908]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:49:44 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:49:44 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:49:44 user devstack@n-api.service[61908]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:49:44 user devstack@n-api.service[61908]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:49:44 user devstack@n-api.service[61908]: method: > Apr 11 20:49:44 user devstack@n-api.service[61908]: exception: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61908]: action_args: {'id': 'dadac585-3a7c-40d8-a335-fc2603588c28'} Apr 11 20:49:44 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:49:44 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:49:44 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:49:44 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-93de91cc-1cf1-4e1f-b2ae-a2a4e209958c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 404 len: 111 microversion: 2.1 time: 0.030240 Apr 11 20:49:44 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 206/619] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:44 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:44 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1870482065", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c"}], "security_groups": [{"name": "tempest-securitygroup--449689845"}], "key_name": "tempest-keypair-1169091087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-505c529b-8add-4664-98a1-556444ba1634 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041715 Apr 11 20:49:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 210/620] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:49:45 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:49:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 204 len: 0 microversion: 2.1 time: 0.139246 Apr 11 20:49:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 205/621] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:49:44 2023] DELETE /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:49:45 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] validate_networks() for [('d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:49:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 204 len: 0 microversion: 2.1 time: 0.179037 Apr 11 20:49:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 206/622] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:49:45 2023] DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-97c64ced-7685-43a0-ab7c-235b232d08e3 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 200 len: 1540 microversion: 2.1 time: 0.262574 Apr 11 20:49:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 211/623] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:45 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 1540 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-unplugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Creating event network-vif-unplugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:49:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048924 Apr 11 20:49:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 212/624] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:45 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-68cc4772-9258-4621-aef5-6253aec04045 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 200 len: 1659 microversion: 2.1 time: 0.313394 Apr 11 20:49:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 207/625] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:45 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 1659 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-unplugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Creating event network-vif-unplugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:49:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031105 Apr 11 20:49:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 213/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:49:46 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:49:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.121848 Apr 11 20:49:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 207/627] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:49:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:49:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-af58b225-c76c-42d8-a9a1-735b6da561cf tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:46 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-af58b225-c76c-42d8-a9a1-735b6da561cf tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:46 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-af58b225-c76c-42d8-a9a1-735b6da561cf tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-af58b225-c76c-42d8-a9a1-735b6da561cf tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670" status: 200 len: 1233 microversion: 2.1 time: 0.143320 Apr 11 20:49:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 208/628] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:46 2023] GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 => generated 1233 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:49:46 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-deleted", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] Creating event network-vif-deleted:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:49:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071368 Apr 11 20:49:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 214/629] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4bccf7-341f-4bc4-ade1-cb948f6dd950", "name": "network-vif-plugged", "status": "completed", "tag": "91830629-fa39-4a76-9eba-4b33f2f66b7a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Creating event network-vif-plugged:91830629-fa39-4a76-9eba-4b33f2f66b7a for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 on user Apr 11 20:49:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058233 Apr 11 20:49:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 208/630] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-plugged", "status": "completed", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}, {"server_uuid": "9613dc9f-5683-4139-bbed-0c2a11c2dc31", "name": "network-vif-deleted", "tag": "087e4499-cfde-448a-b093-08f4b879f946"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Creating event network-vif-plugged:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:49:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Creating event network-vif-deleted:087e4499-cfde-448a-b093-08f4b879f946 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 on user Apr 11 20:49:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029556 Apr 11 20:49:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 209/631] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Creating event network-changed:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:49:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035220 Apr 11 20:49:49 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 215/632] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "name": "network-vif-plugged", "status": "completed", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Creating event network-vif-plugged:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:49:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065215 Apr 11 20:49:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 209/633] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-09c884d5-5a5c-4f3e-a97a-a43440b10551 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Action: 'create', calling method: .version_select at 0x7f72683e9e10>, body: {"keypair": {"name": "tempest-TestShelveInstance-176056509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAWJOf6I9rkJJXNLcDZX/Kb6Vxi27X1aA5/xNyjqDDLkYDF/zBtuVuX91idOh4pF42cJIilfyIyndvzyDZ0CJJ+uJagML47ITzNKfhOoXVlQ3i4YUlRBXFD0Cd/N8jq5A=="}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:52 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-09c884d5-5a5c-4f3e-a97a-a43440b10551 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting quotas for project 2b26639cfda0489797dd5c7fbfc75927. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:49:52 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-09c884d5-5a5c-4f3e-a97a-a43440b10551 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting quotas for user f2ee47ef8e2248dda212a623eab9915b and project 2b26639cfda0489797dd5c7fbfc75927. Resources: {'key_pairs'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:49:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-09c884d5-5a5c-4f3e-a97a-a43440b10551 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.261358 Apr 11 20:49:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 210/634] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:49:52 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "name": "network-vif-plugged", "status": "completed", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Creating event network-vif-plugged:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:49:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037073 Apr 11 20:49:53 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 216/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:49:56 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:56 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:49:56 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-629010364", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-176056509", "security_groups": [{"name": "tempest-secgroup-smoke-1985973357"}], "networks": [{"uuid": "d616994f-0b7d-4e58-b7b3-f1318b6204a7"}], "block_device_mapping_v2": [{"uuid": "5ad85d33-3ca5-44f2-86af-fa4d8044b37b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:49:56 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] validate_networks() for [('d616994f-0b7d-4e58-b7b3-f1318b6204a7', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting quotas for project 2b26639cfda0489797dd5c7fbfc75927. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting quotas for user f2ee47ef8e2248dda212a623eab9915b and project 2b26639cfda0489797dd5c7fbfc75927. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:49:57 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ad85d33-3ca5-44f2-86af-fa4d8044b37b',volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:49:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.717688 Apr 11 20:49:57 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 210/636] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:49:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:49:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-e08a54df-16a1-4c5a-b7b3-55e505f64ce9 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:57 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-e08a54df-16a1-4c5a-b7b3-55e505f64ce9 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:57 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-e08a54df-16a1-4c5a-b7b3-55e505f64ce9 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-e08a54df-16a1-4c5a-b7b3-55e505f64ce9 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1082 microversion: 2.1 time: 0.065381 Apr 11 20:49:57 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 211/637] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:57 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1082 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:49:59 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:49:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1ce7f33c-bb14-49d2-a81f-5ce09cbec632 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 200 len: 1542 microversion: 2.1 time: 0.371712 Apr 11 20:49:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 217/638] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:49:59 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 1542 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:50:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Creating event network-changed:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:50:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038399 Apr 11 20:50:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 211/639] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:50:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:05 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:05 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Creating event network-vif-plugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:50:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046036 Apr 11 20:50:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 212/640] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:50:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=29 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Creating event network-vif-plugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:50:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Apr 11 20:50:07 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 218/641] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:50:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:23 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:23 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5a7010eb-4fe4-451e-b499-47808d8de6f1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1503 microversion: 2.1 time: 0.189978 Apr 11 20:50:23 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 212/642] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:23 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:27 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] HTTP exception thrown: Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c could not be found. Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Request method failure captured: Apr 11 20:50:27 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c HTTP/1.1 Apr 11 20:50:27 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:50:27 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:50:27 user devstack@n-api.service[61909]: Connection: close Apr 11 20:50:27 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:50:27 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:50:27 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:50:27 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:50:27 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcaoU9Fzq8DmRPasWAxeDHSKM-6yJxCJ5TAlbl427nHY2bH_EXC3ZTjNNZCg2dqkgdtsoUXAmQRibvXti-j_ZKzC32KnCpUmyaITY3sNsXAGT9aq8GHkQZsRymk1u71ZHW6iSw5sFtZm-63GKVGnnPu1_VsrWluAIW-vwGZJhFhy7Qs Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Project-Id: 1982dc9f62644e2b8a541dc25854a6a9 Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-323644922 Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1982dc9f62644e2b8a541dc25854a6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1982dc9f62644e2b8a541dc25854a6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1982dc9f62644e2b8a541dc25854a6a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesSnapshotTestJSON-323644922 Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Tenant-Id: 1982dc9f62644e2b8a541dc25854a6a9 Apr 11 20:50:27 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-323644922 Apr 11 20:50:27 user devstack@n-api.service[61909]: X-User: tempest-VolumesSnapshotTestJSON-323644922-project-member Apr 11 20:50:27 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:50:27 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:50:27 user devstack@n-api.service[61909]: X-User-Id: 94e4de8a85394d258268ff4304eccb2d Apr 11 20:50:27 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesSnapshotTestJSON-323644922-project-member Apr 11 20:50:27 user devstack@n-api.service[61909]: method: > Apr 11 20:50:27 user devstack@n-api.service[61909]: exception: Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c could not be found. Apr 11 20:50:27 user devstack@n-api.service[61909]: action_args: {'id': 'dfd1ff89-55fd-454d-a98f-2cab0388b86c'} Apr 11 20:50:27 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c could not be found. Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c could not be found. Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c could not be found. Apr 11 20:50:27 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:50:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Returning 404 to user: Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:50:27 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-51a5e941-8e01-48e9-9f40-152905e40de4 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c" status: 404 len: 111 microversion: 2.1 time: 0.032145 Apr 11 20:50:27 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 213/643] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:27 2023] GET /compute/v2.1/servers/dfd1ff89-55fd-454d-a98f-2cab0388b86c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1838177348"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/action" status: 202 len: 52 microversion: 2.87 time: 1.009273 Apr 11 20:50:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 219/644] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:50:33 2023] POST /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/action => generated 52 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HTTP exception thrown: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Request method failure captured: Apr 11 20:50:35 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 HTTP/1.1 Apr 11 20:50:35 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:50:35 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:50:35 user devstack@n-api.service[61908]: Connection: close Apr 11 20:50:35 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:50:35 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:50:35 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:50:35 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:50:35 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcViOlS8LEd3QPJ88kbES3EiCucmL9xwWjHlXB3MG3neyqH9atP2HhcjcxQSr95ePAyf4DWYqmmMOtk61u9xz3FaOSiCJ1ES-6kqjo4shptrKTUJ1pM_9KjZS6ml3Vp88SetSH0-n3wgcnfFQx_MxqenK8Bjs9S9qUgR-JFKyG6Wut4 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Project-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cdd62a4c803247588716e71c25c62b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Tenant: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Tenant-Id: cdd62a4c803247588716e71c25c62b05 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142191059 Apr 11 20:50:35 user devstack@n-api.service[61908]: X-User: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:50:35 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:50:35 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:50:35 user devstack@n-api.service[61908]: X-User-Id: 0a70ed7ce13442e6b7f6f62b960520ad Apr 11 20:50:35 user devstack@n-api.service[61908]: X-User-Name: tempest-TestMinimumBasicScenario-2142191059-project-member Apr 11 20:50:35 user devstack@n-api.service[61908]: method: > Apr 11 20:50:35 user devstack@n-api.service[61908]: exception: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61908]: action_args: {'id': '0d4bccf7-341f-4bc4-ade1-cb948f6dd950'} Apr 11 20:50:35 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Returning 404 to user: Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:50:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-69e9ee9b-25bc-4606-ba22-25c96f6511b8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950" status: 404 len: 111 microversion: 2.1 time: 0.261999 Apr 11 20:50:35 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 213/645] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:35 2023] GET /compute/v2.1/servers/0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:50:35 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cd4cdd66-c846-40b9-9276-a1ca0ea2a20f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Calling method '.version_select at 0x7f726839d7e0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:35 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-cd4cdd66-c846-40b9-9276-a1ca0ea2a20f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1187350393" status: 202 len: 0 microversion: 2.1 time: 0.023211 Apr 11 20:50:35 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 214/646] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 20:50:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1187350393 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HTTP exception thrown: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Request method failure captured: Apr 11 20:50:35 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 HTTP/1.1 Apr 11 20:50:35 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:50:35 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:50:35 user devstack@n-api.service[61907]: Connection: close Apr 11 20:50:35 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:50:35 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:50:35 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:50:35 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:50:35 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcWx3H5Y0V9djbX8GtPJ_c7_0c39nQIPx4NkZa6-VkF_xSngHCGzV531Leub3woaOHONz3sLMel9ArDC5E2psjM7uVyzWPw3f-3etLvgAWch_2Ukfb8Tc36Oj_6ij7st0_OSFX7Bfg_Jet4T6IAGzOuSUhQlaot8yTgafA6HpJPa-eg Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Project-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Tenant-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:50:35 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:50:35 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:50:35 user devstack@n-api.service[61907]: X-User-Id: 3c9f583cc98040bc822e1ac7e418aa98 Apr 11 20:50:35 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:50:35 user devstack@n-api.service[61907]: method: > Apr 11 20:50:35 user devstack@n-api.service[61907]: exception: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61907]: action_args: {'id': '9613dc9f-5683-4139-bbed-0c2a11c2dc31'} Apr 11 20:50:35 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:50:35 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:50:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Returning 404 to user: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:50:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1d474f43-af10-42be-b67d-fcd47aa81b0c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 404 len: 111 microversion: 2.1 time: 0.032408 Apr 11 20:50:35 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 220/647] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:35 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 20:50:35 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f4760a14-e2fe-4064-8ec3-5b11f1353486 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '.version_select at 0x7f72684a3910>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:35 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f4760a14-e2fe-4064-8ec3-5b11f1353486 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641505706" status: 202 len: 0 microversion: 2.1 time: 0.023599 Apr 11 20:50:35 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 214/648] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:50:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641505706 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:36 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-66dcef33-c180-411e-9658-3a5bb084c520 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670" status: 200 len: 1540 microversion: 2.1 time: 0.324287 Apr 11 20:50:36 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 215/649] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:36 2023] GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 => generated 1540 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:50:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-19d54c9e-4c5c-45cd-af66-cc9b45512c37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: .version_select at 0x7f726856a050>, body: {"keypair": {"name": "tempest-keypair-1071709161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LFqTUJ86qBSmeqQO1lrWwO+uCgMsoSXQidDgh1SeikH6h4Q1C3DQBzCRzlAXCIRNnIzC6RPtA2crTM5XdtUjbZsogjvbwXzftGF/y23Q0o2MxzRVYIuEKvuap1tGsow=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:36 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-19d54c9e-4c5c-45cd-af66-cc9b45512c37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:50:36 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-19d54c9e-4c5c-45cd-af66-cc9b45512c37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for user 3c9f583cc98040bc822e1ac7e418aa98 and project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:50:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-19d54c9e-4c5c-45cd-af66-cc9b45512c37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094936 Apr 11 20:50:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 221/650] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:50:36 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:50:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-248702197", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f87b05c6-655f-40f5-9d5d-73525169adaa"}], "security_groups": [{"name": "tempest-securitygroup--622279179"}], "key_name": "tempest-keypair-1071709161", "user_data": "}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:38 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] validate_networks() for [('f87b05c6-655f-40f5-9d5d-73525169adaa', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting quotas for user 3c9f583cc98040bc822e1ac7e418aa98 and project 426d5e042ba34969a2bfdc0c89da11e8. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:50:39 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:50:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.717546 Apr 11 20:50:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 215/651] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:50:38 2023] POST /compute/v2.1/servers => generated 399 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:50:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-276f2bc2-cdcc-4f64-b945-ab94f71c8cbd tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:39 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-276f2bc2-cdcc-4f64-b945-ab94f71c8cbd tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:39 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-276f2bc2-cdcc-4f64-b945-ab94f71c8cbd tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-276f2bc2-cdcc-4f64-b945-ab94f71c8cbd tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 200 len: 1231 microversion: 2.1 time: 0.062760 Apr 11 20:50:39 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 216/652] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:39 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 1231 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:40 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b29d7c23-425c-494c-be76-7ef7ca346f2e tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" status: 200 len: 1689 microversion: 2.87 time: 0.225719 Apr 11 20:50:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 222/653] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:50:40 2023] GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:50:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Creating event network-changed:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:50:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035986 Apr 11 20:50:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 216/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:50:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "name": "network-vif-plugged", "status": "completed", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Creating event network-vif-plugged:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:50:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032682 Apr 11 20:50:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 217/655] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:50:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:50:46 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "name": "network-vif-plugged", "status": "completed", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:50:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Creating event network-vif-plugged:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:50:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030186 Apr 11 20:50:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 223/656] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:50:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:47 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:50:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c850b4f3-64b4-4966-95fc-204f9f27c99a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1432 microversion: 2.1 time: 0.167228 Apr 11 20:50:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 217/657] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:50:47 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1432 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:50:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8511da86-92a3-43e5-9276-5308c8c5f045 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.104792 Apr 11 20:51:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 218/658] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:50:59 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-interface => generated 282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Creating event network-changed:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:51:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038478 Apr 11 20:51:00 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 224/659] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8f37ed42-f870-4a63-95b8-56a2d5cae627 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/ips" status: 200 len: 107 microversion: 2.1 time: 0.059185 Apr 11 20:51:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 218/660] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:51:00 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/ips => generated 107 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d307d267-3ade-4892-9e38-572afec8c314"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267168 Apr 11 20:51:02 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 219/661] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:51:02 2023] POST /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d307d267-3ade-4892-9e38-572afec8c314"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Invalid volume: volume d307d267-3ade-4892-9e38-572afec8c314 is already attached to instances: 7d336b76-477f-48c0-aa96-21b5d40d1754 Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:51:10 user devstack@n-api.service[61907]: request: POST /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments HTTP/1.1 Apr 11 20:51:10 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:51:10 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:51:10 user devstack@n-api.service[61907]: Connection: close Apr 11 20:51:10 user devstack@n-api.service[61907]: Content-Length: 74 Apr 11 20:51:10 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:51:10 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:51:10 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:51:10 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:51:10 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:51:10 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:51:10 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:51:10 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:51:10 user devstack@n-api.service[61907]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:51:10 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:51:10 user devstack@n-api.service[61907]: Apr 11 20:51:10 user devstack@n-api.service[61907]: {"volumeAttachment": {"volumeId": "d307d267-3ade-4892-9e38-572afec8c314"}} Apr 11 20:51:10 user devstack@n-api.service[61907]: method: > Apr 11 20:51:10 user devstack@n-api.service[61907]: exception: Invalid volume: volume d307d267-3ade-4892-9e38-572afec8c314 is already attached to instances: 7d336b76-477f-48c0-aa96-21b5d40d1754 Apr 11 20:51:10 user devstack@n-api.service[61907]: action_args: {'server_id': '7d336b76-477f-48c0-aa96-21b5d40d1754', 'body': {'volumeAttachment': {'volumeId': 'd307d267-3ade-4892-9e38-572afec8c314'}}} Apr 11 20:51:10 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d307d267-3ade-4892-9e38-572afec8c314 is already attached to instances: 7d336b76-477f-48c0-aa96-21b5d40d1754 Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d307d267-3ade-4892-9e38-572afec8c314 is already attached to instances: 7d336b76-477f-48c0-aa96-21b5d40d1754 Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d307d267-3ade-4892-9e38-572afec8c314 is already attached to instances: 7d336b76-477f-48c0-aa96-21b5d40d1754 Apr 11 20:51:10 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:51:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 400 to user: Invalid volume: volume d307d267-3ade-4892-9e38-572afec8c314 is already attached to instances: 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:51:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-4018a92e-0d00-44db-ab68-4df1e52fec6b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097226 Apr 11 20:51:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 225/662] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:51:10 2023] POST /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:10 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'services' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:51:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments/d307d267-3ade-4892-9e38-572afec8c314" status: 202 len: 0 microversion: 2.1 time: 0.157770 Apr 11 20:51:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 219/663] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:51:10 2023] DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments/d307d267-3ade-4892-9e38-572afec8c314 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:10 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8ab8da8a-ee6a-4551-a5ec-90c10bec32d7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Apr 11 20:51:10 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 220/664] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:51:10 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-cb140be2-3aff-4f19-be02-f7a1de6349a8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'create', calling method: .version_select at 0x7f72683c64d0>, body: {"keypair": {"name": "tempest-keypair-440521057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4x6uP246VWRPkKSeoaF0rKad7haM9o+g0vO55lyTBMphQrGzfiAPwPyJOIeXbxZxLBgRKOqIaGp/M0eiVeOUEpldUvWk5YlfA9kM4Hp1+g48Kwhly6qXWHqLhlF/xwtA=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:25 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:25 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:25 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-cb140be2-3aff-4f19-be02-f7a1de6349a8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:51:25 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-cb140be2-3aff-4f19-be02-f7a1de6349a8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for user dce0b6fa6d9546c8a04b7a4a5f93e0c7 and project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:51:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-cb140be2-3aff-4f19-be02-f7a1de6349a8 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055271 Apr 11 20:51:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 226/665] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:51:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1225023406", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1ee91002-b796-478b-b740-f3297b37e1f0"}], "security_groups": [{"name": "tempest-securitygroup--608919394"}], "key_name": "tempest-keypair-440521057", "user_data": "}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:26 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:26 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:26 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] validate_networks() for [('1ee91002-b796-478b-b740-f3297b37e1f0', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting quotas for user dce0b6fa6d9546c8a04b7a4a5f93e0c7 and project a2ad2f73c14141dd8f7aa0d6f6c747b0. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:51:27 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:51:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671368 Apr 11 20:51:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 220/666] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:51:26 2023] POST /compute/v2.1/servers => generated 406 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:51:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5e2ae941-6cd2-42bc-8963-153ac22dcc4b tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:27 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5e2ae941-6cd2-42bc-8963-153ac22dcc4b tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:27 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:27 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:27 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-5e2ae941-6cd2-42bc-8963-153ac22dcc4b tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:27 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5e2ae941-6cd2-42bc-8963-153ac22dcc4b tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1239 microversion: 2.1 time: 0.070958 Apr 11 20:51:27 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 221/667] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:51:27 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:29 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-91c122fd-d1fc-4387-9e20-f1a6f5acf77e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 200 len: 1536 microversion: 2.1 time: 0.336769 Apr 11 20:51:29 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 227/668] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:51:29 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 1536 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:51:30 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:30 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Creating event network-changed:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:51:30 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048350 Apr 11 20:51:30 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 221/669] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:51:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Apr 11 20:51:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 222/670] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:51:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082018 Apr 11 20:51:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 228/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c53740e9-f6d7-4fc6-8df0-e4ceeb01247d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.244175 Apr 11 20:51:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 222/672] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:51:36 2023] GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670/os-interface => generated 283 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:37 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Creating event network-changed:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:51:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102406 Apr 11 20:51:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 223/673] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:39 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1177514325", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c"}], "security_groups": [{"name": "tempest-securitygroup--449689845"}], "key_name": "tempest-keypair-1169091087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2e9baedf-a70c-41a1-8578-21a40984963e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:39 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] validate_networks() for [('d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:51:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e9baedf-a70c-41a1-8578-21a40984963e',volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:51:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.853112 Apr 11 20:51:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 229/674] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:51:39 2023] POST /compute/v2.1/servers => generated 403 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:51:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-88b0baf9-9725-4f19-9478-bbf91bb9b363 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:40 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-88b0baf9-9725-4f19-9478-bbf91bb9b363 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:40 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-88b0baf9-9725-4f19-9478-bbf91bb9b363 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:40 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-88b0baf9-9725-4f19-9478-bbf91bb9b363 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1076 microversion: 2.1 time: 0.068825 Apr 11 20:51:40 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 223/675] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:51:40 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1076 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:51:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-494251155", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "destination_type": "volume"}], "networks": [{"uuid": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] validate_networks() for [('6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting quotas for user 1d5cb62cc3844248be2e4456d970ccdf and project 85bf8fe34838426ea05060463458e5e0. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:51:41 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:51:41 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.553658 Apr 11 20:51:41 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 224/676] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 20:51:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 20:51:41 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b8870327-d68e-4847-b5c0-cea00aa8b330 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:41 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b8870327-d68e-4847-b5c0-cea00aa8b330 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b8870327-d68e-4847-b5c0-cea00aa8b330 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b8870327-d68e-4847-b5c0-cea00aa8b330 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:41 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-b8870327-d68e-4847-b5c0-cea00aa8b330 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b8870327-d68e-4847-b5c0-cea00aa8b330 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1394 microversion: 2.87 time: 0.078042 Apr 11 20:51:41 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 230/677] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:51:41 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:51:43 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:43 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Creating event network-changed:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:51:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094504 Apr 11 20:51:43 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 224/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:44 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:44 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Creating event network-changed:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:51:44 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039387 Apr 11 20:51:44 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 225/679] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:47 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-073f88c3-dcb8-4350-8290-e0ebc68677fe tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1432 microversion: 2.1 time: 0.149782 Apr 11 20:51:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 231/680] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:51:47 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1432 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:51:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-plugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Creating event network-vif-plugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:51:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Apr 11 20:51:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 225/681] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:50 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'flavor' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:51:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/action" status: 202 len: 0 microversion: 2.1 time: 0.101835 Apr 11 20:51:50 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 226/682] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:51:50 2023] POST /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:50 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-unplugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:50 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:51:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8e4ab16f-dfc1-4ca3-a97b-6e6ad555574e tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1438 microversion: 2.1 time: 0.298894 Apr 11 20:51:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 232/683] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:51:50 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1438 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:51:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Creating event network-vif-unplugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:51:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042348 Apr 11 20:51:50 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 226/684] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-plugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}, {"name": "network-changed", "server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Creating event network-vif-plugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:51:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Creating event network-changed:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:51:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044575 Apr 11 20:51:51 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 227/685] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:51 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}, {"name": "network-changed", "server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:52 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Creating event network-vif-plugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:51:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Creating event network-changed:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:51:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037201 Apr 11 20:51:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 233/686] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:56 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:56 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:56 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:56 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:51:56 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042476 Apr 11 20:51:56 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 227/687] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:51:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:51:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:51:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064514 Apr 11 20:51:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 228/688] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:51:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:00 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=25 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-630d7d6f-6568-4601-8926-883c511b4132 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053981 Apr 11 20:52:00 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 234/689] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:52:00 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=17 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:00 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:52:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 204 len: 0 microversion: 2.1 time: 0.129227 Apr 11 20:52:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 228/690] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:52:00 2023] DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-31ffd89b-6441-447b-850a-3e84bd1f1425 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 200 len: 1667 microversion: 2.1 time: 0.205837 Apr 11 20:52:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 229/691] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:00 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 1667 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:52:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "name": "network-vif-unplugged", "status": "completed", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Creating event network-vif-unplugged:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:52:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035027 Apr 11 20:52:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 235/692] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "name": "network-vif-deleted", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] Creating event network-vif-deleted:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:52:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 Apr 11 20:52:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 229/693] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d336b76-477f-48c0-aa96-21b5d40d1754", "name": "network-vif-plugged", "status": "completed", "tag": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Creating event network-vif-plugged:4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 on user Apr 11 20:52:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027604 Apr 11 20:52:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 230/694] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=7 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:17 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e4d89b8a-a325-46c6-88de-e3c6bb3b444c tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1552 microversion: 2.1 time: 0.165149 Apr 11 20:52:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 236/695] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:17 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:30 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ec6b5be4-2bfe-45d6-856e-5d0387c6eb65 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100955 Apr 11 20:52:30 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 230/696] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:52:29 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-interface => generated 283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=5 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=9 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:30 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-db52bb37-5536-4566-a483-e1f476417123 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1429 microversion: 2.1 time: 0.170751 Apr 11 20:52:30 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 231/697] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:30 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1429 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:52:31 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:31 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:31 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:52:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Creating event network-changed:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:52:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033207 Apr 11 20:52:31 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 237/698] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:31 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1a8bc1b5-c654-430d-b3d4-fed085f918f6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/ips" status: 200 len: 104 microversion: 2.1 time: 0.043494 Apr 11 20:52:31 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 231/699] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:52:31 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/ips => generated 104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:31 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:31 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-bad3185a-4802-4b37-8a50-75a04f9ab567 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1767 microversion: 2.87 time: 0.170564 Apr 11 20:52:31 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 232/700] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:52:31 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1767 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd64c2f-7416-438c-9b82-dc46f784381f"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291999 Apr 11 20:52:32 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 238/701] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:52:32 2023] POST /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5f4854eb-1466-4225-8df4-efce59aab454 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071662 Apr 11 20:52:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 232/702] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:52:39 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-94ec3cda-0258-4044-ab35-51116a93ee37 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/6cd64c2f-7416-438c-9b82-dc46f784381f" status: 200 len: 194 microversion: 2.1 time: 0.038133 Apr 11 20:52:39 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 233/703] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 20:52:39 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/6cd64c2f-7416-438c-9b82-dc46f784381f => generated 194 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:40 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-5a4b82d2-6192-4427-9ba4-2130c484b891 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1498 microversion: 2.1 time: 0.162429 Apr 11 20:52:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 239/704] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:40 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76633014-3a8e-4034-9681-70b222a6053c"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "POST /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269889 Apr 11 20:52:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 233/705] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:52:40 2023] POST /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-3b11af4d-6bf7-4742-b934-68b50232d727 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049037 Apr 11 20:52:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 234/706] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:52:47 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-efdc0aae-932c-44d5-b503-21867d06b644 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/6cd64c2f-7416-438c-9b82-dc46f784381f" status: 200 len: 194 microversion: 2.1 time: 0.041752 Apr 11 20:52:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 240/707] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 20:52:47 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/6cd64c2f-7416-438c-9b82-dc46f784381f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:47 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'services' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:52:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/6cd64c2f-7416-438c-9b82-dc46f784381f" status: 202 len: 0 microversion: 2.1 time: 0.178682 Apr 11 20:52:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 234/708] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:52:47 2023] DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/6cd64c2f-7416-438c-9b82-dc46f784381f => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-da784adb-b8ce-45f3-b4ee-95bdf922b8fc tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/76633014-3a8e-4034-9681-70b222a6053c" status: 200 len: 194 microversion: 2.1 time: 0.041644 Apr 11 20:52:50 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 235/709] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 20:52:50 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/76633014-3a8e-4034-9681-70b222a6053c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:50 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'services' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:52:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/76633014-3a8e-4034-9681-70b222a6053c" status: 202 len: 0 microversion: 2.1 time: 0.165341 Apr 11 20:52:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 241/710] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:52:50 2023] DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments/76633014-3a8e-4034-9681-70b222a6053c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:52:51 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 HTTP/1.1 Apr 11 20:52:51 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:52:51 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:52:51 user devstack@n-api.service[61908]: Connection: close Apr 11 20:52:51 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:52:51 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:52:51 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:52:51 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:52:51 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:52:51 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:52:51 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:52:51 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:52:51 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:52:51 user devstack@n-api.service[61908]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:52:51 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:52:51 user devstack@n-api.service[61908]: method: > Apr 11 20:52:51 user devstack@n-api.service[61908]: exception: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:52:51 user devstack@n-api.service[61908]: action_args: {'id': '7d336b76-477f-48c0-aa96-21b5d40d1754'} Apr 11 20:52:51 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:52:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:52:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:52:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c2d13bc5-ed06-499c-bb93-a1f6c87930e0 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 404 len: 111 microversion: 2.1 time: 0.033789 Apr 11 20:52:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 235/711] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:51 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:52:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0c851bb1-69e1-489a-a55b-bdb10d9a65b1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '.version_select at 0x7f726839d7e0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0c851bb1-69e1-489a-a55b-bdb10d9a65b1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319392662" status: 202 len: 0 microversion: 2.1 time: 0.023731 Apr 11 20:52:51 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 236/712] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:52:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319392662 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b7036294-7d6d-4a78-937b-4963c0248709 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: .version_select at 0x7f726826d3f0>, body: {"keypair": {"name": "tempest-keypair-603118687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9M4nnLv9Kfngmmqa7wkotIEWs8NxuvYlnAPRxw7BkkUknV89fssNUDjI1CbZKjVpD+GtYJIY+uSuPWmyuAoezhPKAnxJuD6Sj0KDjy1vzY/LdFc26BOZVKvfXugfj6Zw=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-b7036294-7d6d-4a78-937b-4963c0248709 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-b7036294-7d6d-4a78-937b-4963c0248709 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:52:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b7036294-7d6d-4a78-937b-4963c0248709 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051644 Apr 11 20:52:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 242/713] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 20:52:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-0f8636fa-41c3-49a2-be00-2ef735302845 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045233 Apr 11 20:52:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 236/714] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:52:52 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-dc2ff086-f139-476e-a93f-5595e107b5b7 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041876 Apr 11 20:52:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 237/715] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:52:52 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:52 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:52:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 204 len: 0 microversion: 2.1 time: 0.112616 Apr 11 20:52:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 243/716] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:52:52 2023] DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:52 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:53 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:53 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-bcb27f3b-05cd-4494-aa40-1a6c13bdb765 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 200 len: 1661 microversion: 2.1 time: 0.245370 Apr 11 20:52:53 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 237/717] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:52 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 1661 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:52:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "name": "network-vif-unplugged", "status": "completed", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Creating event network-vif-unplugged:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:52:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030450 Apr 11 20:52:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 238/718] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:54 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1708531122", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0"}], "security_groups": [{"name": "tempest-securitygroup--1863528678"}], "key_name": "tempest-keypair-603118687", "user_data": "}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:54 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] validate_networks() for [('2e7f3602-ac71-4117-82aa-d6e25c53d5d0', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "name": "network-vif-deleted", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] Creating event network-vif-deleted:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:52:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034555 Apr 11 20:52:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 238/719] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting quotas for user 4f69b01612974865be4e1e1b6a9bd570 and project db28134878ba46528b7d5012ff9c7aff. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:52:55 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:52:55 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632ddb45-81b6-4107-ba86-98af48ee9481", "name": "network-vif-plugged", "status": "completed", "tag": "df89f670-8dc8-440c-b165-1864ccec6d2b"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Creating event network-vif-plugged:df89f670-8dc8-440c-b165-1864ccec6d2b for instance 632ddb45-81b6-4107-ba86-98af48ee9481 on user Apr 11 20:52:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.751184 Apr 11 20:52:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 244/720] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:52:54 2023] POST /compute/v2.1/servers => generated 400 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:52:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030369 Apr 11 20:52:55 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 239/721] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cec4db36-66f0-47ac-8350-731c3b11d764 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cec4db36-66f0-47ac-8350-731c3b11d764 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:52:55 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cec4db36-66f0-47ac-8350-731c3b11d764 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:52:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cec4db36-66f0-47ac-8350-731c3b11d764 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 200 len: 1235 microversion: 2.1 time: 0.111608 Apr 11 20:52:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 239/722] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:52:55 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 1235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:52:57 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Creating event network-changed:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:52:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028498 Apr 11 20:52:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 245/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:52:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "name": "network-vif-plugged", "status": "completed", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:52:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:52:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:52:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:52:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Creating event network-vif-plugged:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:52:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032470 Apr 11 20:52:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 240/724] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "name": "network-vif-plugged", "status": "completed", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:01 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=23 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:01 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Creating event network-vif-plugged:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:53:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033147 Apr 11 20:53:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 240/725] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=10 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c723b453-459e-41c5-9ee1-35fa4d08b0e1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103571 Apr 11 20:53:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 246/726] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:53:17 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=42 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Creating event network-changed:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:53:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040820 Apr 11 20:53:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 241/727] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:19 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:19 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347120 Apr 11 20:53:20 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 241/728] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:53:19 2023] POST /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:27 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:53:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/action" status: 200 len: 32 microversion: 2.1 time: 0.151900 Apr 11 20:53:28 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 247/729] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:53:27 2023] POST /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:28 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:28 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-aa8e4300-cd4f-4fc3-a6c5-08fd4ffe91f5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1722 microversion: 2.1 time: 0.158621 Apr 11 20:53:28 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 242/730] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:28 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:53:28 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-unplugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Creating event network-vif-unplugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:53:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032744 Apr 11 20:53:28 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 242/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:30 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:30 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8b387d5f-851d-4333-a3ac-7de16ffda9c5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.097073 Apr 11 20:53:30 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 248/732] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:53:30 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/os-interface => generated 283 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:53:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032459 Apr 11 20:53:30 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 243/733] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "98a81352-92ff-4819-ae8b-904e24fcc8b6"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c344c911-0693-4652-963f-6bffb8c9846c tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1429 microversion: 2.1 time: 0.195306 Apr 11 20:53:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 243/734] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:32 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1429 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Old instance type m1.nano, new instance type m1.micro {{(pid=61909) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting quotas for user 7736d32586e949e4839f826f18994a0f and project 9d0c94dce35b4883940b8399d6d0ba7e. Resources: {'cores', 'ram'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:53:32 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'flavor' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:53:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/action" status: 202 len: 0 microversion: 2.1 time: 0.267539 Apr 11 20:53:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 244/735] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:53:32 2023] POST /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-723284b6-4fcd-44bb-8114-8c40c3088413 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1438 microversion: 2.1 time: 0.171810 Apr 11 20:53:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 244/736] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:32 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1438 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:53:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/action" status: 200 len: 29 microversion: 2.87 time: 0.645868 Apr 11 20:53:32 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 249/737] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:53:32 2023] POST /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/action => generated 29 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:32 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-02c926fc-fd59-4b31-9e5c-230e90467ff8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1773 microversion: 2.87 time: 0.200211 Apr 11 20:53:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 245/738] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:53:32 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1773 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:53:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}, {"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}, {"name": "network-changed", "server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}, {"name": "network-changed", "server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:53:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:53:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Creating event network-changed:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:53:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Creating event network-changed:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:53:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.046156 Apr 11 20:53:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 245/739] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-unplugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Creating event network-vif-unplugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:53:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039987 Apr 11 20:53:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 250/740] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:53:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030553 Apr 11 20:53:36 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 246/741] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:36 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-unplugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Creating event network-vif-unplugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:53:36 user devstack@n-api.service[61908]: DEBUG nova.compute.api [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61908) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:53:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039873 Apr 11 20:53:36 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 246/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:38 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:38 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:53:38 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Apr 11 20:53:38 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 251/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-plugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Creating event network-vif-plugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:53:38 user devstack@n-api.service[61909]: DEBUG nova.compute.api [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61909) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:53:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048629 Apr 11 20:53:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 247/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:53:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036823 Apr 11 20:53:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 252/745] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:40 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61908) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 20:53:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/action" status: 202 len: 0 microversion: 2.1 time: 0.304900 Apr 11 20:53:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 247/746] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:53:40 2023] POST /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:41 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:41 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-809fd269-2ca4-412f-970c-d90d90b584ee tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1506 microversion: 2.1 time: 0.476194 Apr 11 20:53:41 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 248/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:41 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HTTP exception thrown: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Request method failure captured: Apr 11 20:53:43 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 HTTP/1.1 Apr 11 20:53:43 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:53:43 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:53:43 user devstack@n-api.service[61907]: Connection: close Apr 11 20:53:43 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:53:43 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:53:43 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:53:43 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:53:43 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcWx3H5Y0V9djbX8GtPJ_c7_0c39nQIPx4NkZa6-VkF_xSngHCGzV531Leub3woaOHONz3sLMel9ArDC5E2psjM7uVyzWPw3f-3etLvgAWch_2Ukfb8Tc36Oj_6ij7st0_OSFX7Bfg_Jet4T6IAGzOuSUhQlaot8yTgafA6HpJPa-eg Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Project-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Tenant-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:43 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:53:43 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:53:43 user devstack@n-api.service[61907]: X-User-Id: 3c9f583cc98040bc822e1ac7e418aa98 Apr 11 20:53:43 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:43 user devstack@n-api.service[61907]: method: > Apr 11 20:53:43 user devstack@n-api.service[61907]: exception: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:43 user devstack@n-api.service[61907]: action_args: {'id': '632ddb45-81b6-4107-ba86-98af48ee9481'} Apr 11 20:53:43 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:43 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:43 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Returning 404 to user: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:53:43 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-53b06b7d-4363-442f-ab6c-ddd2c869ab32 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 404 len: 111 microversion: 2.1 time: 0.034243 Apr 11 20:53:43 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 253/748] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:43 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:53:43 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-98a5d4d5-b942-4f1d-9aad-ed5b46b1ef6f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '.version_select at 0x7f726879eb90>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:43 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-98a5d4d5-b942-4f1d-9aad-ed5b46b1ef6f tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071709161" status: 202 len: 0 microversion: 2.1 time: 0.053421 Apr 11 20:53:43 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 248/749] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 20:53:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071709161 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:45 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:53:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-43ddf90e-098d-4fe2-97e1-8a4be1356413 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 200 len: 1544 microversion: 2.1 time: 0.238951 Apr 11 20:53:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 249/750] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:45 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HTTP exception thrown: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Request method failure captured: Apr 11 20:53:49 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 HTTP/1.1 Apr 11 20:53:49 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:53:49 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:53:49 user devstack@n-api.service[61907]: Connection: close Apr 11 20:53:49 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:53:49 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:53:49 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:53:49 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:53:49 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcWx3H5Y0V9djbX8GtPJ_c7_0c39nQIPx4NkZa6-VkF_xSngHCGzV531Leub3woaOHONz3sLMel9ArDC5E2psjM7uVyzWPw3f-3etLvgAWch_2Ukfb8Tc36Oj_6ij7st0_OSFX7Bfg_Jet4T6IAGzOuSUhQlaot8yTgafA6HpJPa-eg Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Project-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Tenant-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:49 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:53:49 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:53:49 user devstack@n-api.service[61907]: X-User-Id: 3c9f583cc98040bc822e1ac7e418aa98 Apr 11 20:53:49 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:49 user devstack@n-api.service[61907]: method: > Apr 11 20:53:49 user devstack@n-api.service[61907]: exception: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61907]: action_args: {'id': '632ddb45-81b6-4107-ba86-98af48ee9481'} Apr 11 20:53:49 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Returning 404 to user: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:53:49 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d319294f-0891-4afc-9456-3f9626081047 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 404 len: 111 microversion: 2.1 time: 0.028633 Apr 11 20:53:49 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 254/751] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:53:49 2023] DELETE /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HTTP exception thrown: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Request method failure captured: Apr 11 20:53:49 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 HTTP/1.1 Apr 11 20:53:49 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:53:49 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:53:49 user devstack@n-api.service[61908]: Connection: close Apr 11 20:53:49 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:53:49 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:53:49 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:53:49 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:53:49 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcWx3H5Y0V9djbX8GtPJ_c7_0c39nQIPx4NkZa6-VkF_xSngHCGzV531Leub3woaOHONz3sLMel9ArDC5E2psjM7uVyzWPw3f-3etLvgAWch_2Ukfb8Tc36Oj_6ij7st0_OSFX7Bfg_Jet4T6IAGzOuSUhQlaot8yTgafA6HpJPa-eg Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Project-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Tenant-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:49 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:53:49 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:53:49 user devstack@n-api.service[61908]: X-User-Id: 3c9f583cc98040bc822e1ac7e418aa98 Apr 11 20:53:49 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:49 user devstack@n-api.service[61908]: method: > Apr 11 20:53:49 user devstack@n-api.service[61908]: exception: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61908]: action_args: {'id': '632ddb45-81b6-4107-ba86-98af48ee9481'} Apr 11 20:53:49 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. Apr 11 20:53:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Returning 404 to user: Instance 632ddb45-81b6-4107-ba86-98af48ee9481 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:53:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-18faba34-5cca-415d-8669-0cf8bec8e6b6 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481" status: 404 len: 111 microversion: 2.1 time: 0.363812 Apr 11 20:53:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 249/752] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:49 2023] GET /compute/v2.1/servers/632ddb45-81b6-4107-ba86-98af48ee9481 => generated 111 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:53:50 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:50 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=33 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:50 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Creating event network-changed:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:53:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032265 Apr 11 20:53:50 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 250/753] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-plugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Creating event network-vif-plugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:53:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61907) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:53:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039666 Apr 11 20:53:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 255/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:53:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HTTP exception thrown: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Request method failure captured: Apr 11 20:53:51 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 HTTP/1.1 Apr 11 20:53:51 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:53:51 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:53:51 user devstack@n-api.service[61908]: Connection: close Apr 11 20:53:51 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:53:51 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:53:51 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:53:51 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:53:51 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcWx3H5Y0V9djbX8GtPJ_c7_0c39nQIPx4NkZa6-VkF_xSngHCGzV531Leub3woaOHONz3sLMel9ArDC5E2psjM7uVyzWPw3f-3etLvgAWch_2Ukfb8Tc36Oj_6ij7st0_OSFX7Bfg_Jet4T6IAGzOuSUhQlaot8yTgafA6HpJPa-eg Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Project-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Tenant-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:51 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:53:51 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:53:51 user devstack@n-api.service[61908]: X-User-Id: 3c9f583cc98040bc822e1ac7e418aa98 Apr 11 20:53:51 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:51 user devstack@n-api.service[61908]: method: > Apr 11 20:53:51 user devstack@n-api.service[61908]: exception: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61908]: action_args: {'id': '9613dc9f-5683-4139-bbed-0c2a11c2dc31'} Apr 11 20:53:51 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Returning 404 to user: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:53:51 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-b03c1616-7c38-477c-b640-0c647ba34154 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 404 len: 111 microversion: 2.1 time: 0.038545 Apr 11 20:53:51 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 250/755] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:53:51 2023] DELETE /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HTTP exception thrown: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Request method failure captured: Apr 11 20:53:51 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 HTTP/1.1 Apr 11 20:53:51 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:53:51 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:53:51 user devstack@n-api.service[61909]: Connection: close Apr 11 20:53:51 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:53:51 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:53:51 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:53:51 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:53:51 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcWx3H5Y0V9djbX8GtPJ_c7_0c39nQIPx4NkZa6-VkF_xSngHCGzV531Leub3woaOHONz3sLMel9ArDC5E2psjM7uVyzWPw3f-3etLvgAWch_2Ukfb8Tc36Oj_6ij7st0_OSFX7Bfg_Jet4T6IAGzOuSUhQlaot8yTgafA6HpJPa-eg Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Project-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426d5e042ba34969a2bfdc0c89da11e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Tenant-Id: 426d5e042ba34969a2bfdc0c89da11e8 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-968541948 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:51 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:53:51 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:53:51 user devstack@n-api.service[61909]: X-User-Id: 3c9f583cc98040bc822e1ac7e418aa98 Apr 11 20:53:51 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeTestJSON-968541948-project-member Apr 11 20:53:51 user devstack@n-api.service[61909]: method: > Apr 11 20:53:51 user devstack@n-api.service[61909]: exception: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61909]: action_args: {'id': '9613dc9f-5683-4139-bbed-0c2a11c2dc31'} Apr 11 20:53:51 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. Apr 11 20:53:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:53:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Returning 404 to user: Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:53:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-4eac1918-09c7-4c34-9313-f0599e4c5bc3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31" status: 404 len: 111 microversion: 2.1 time: 0.033997 Apr 11 20:53:51 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 251/756] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:53:51 2023] GET /compute/v2.1/servers/9613dc9f-5683-4139-bbed-0c2a11c2dc31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:53:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-plugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Creating event network-vif-plugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:53:53 user devstack@n-api.service[61907]: DEBUG nova.compute.api [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61907) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 20:53:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039982 Apr 11 20:53:53 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 256/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:54 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:54 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Creating event network-vif-plugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:53:54 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041245 Apr 11 20:53:54 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 251/758] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:56 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:53:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:53:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:53:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:53:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Creating event network-vif-plugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:53:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047944 Apr 11 20:53:56 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 252/759] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:53:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:57 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b6b53dd8-6524-4ca2-9cfd-f9466c013c8c tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f726856aef0>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b6b53dd8-6524-4ca2-9cfd-f9466c013c8c tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/717453df-201e-4497-a6cf-dde0a71653dc" status: 200 len: 351 microversion: 2.1 time: 0.058208 Apr 11 20:53:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 257/760] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 20:53:57 2023] GET /compute/v2.1/os-volumes/717453df-201e-4497-a6cf-dde0a71653dc => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:53:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-046eea38-bcce-4581-b3b1-b2794a40677a tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72683c9f30>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:53:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-046eea38-bcce-4581-b3b1-b2794a40677a tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4017af1-24f1-4a84-8812-09ac49362fb1" status: 200 len: 351 microversion: 2.1 time: 0.124793 Apr 11 20:53:59 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 252/761] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 20:53:59 2023] GET /compute/v2.1/os-volumes/d4017af1-24f1-4a84-8812-09ac49362fb1 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-7420a304-6e2f-4a6d-a5f8-3335367a8b2b tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72684d84c0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-7420a304-6e2f-4a6d-a5f8-3335367a8b2b tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/281f1913-976d-42df-965e-d9beb0d37376" status: 200 len: 351 microversion: 2.1 time: 0.052049 Apr 11 20:54:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 253/762] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 20:54:00 2023] GET /compute/v2.1/os-volumes/281f1913-976d-42df-965e-d9beb0d37376 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:00 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-809e2f1e-d8c6-4337-9b57-57be36dba041 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72685c9d80>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:00 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-809e2f1e-d8c6-4337-9b57-57be36dba041 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.090845 Apr 11 20:54:00 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 258/763] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 20:54:00 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-bd342450-2625-4d00-991d-cd0bf755cef2 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72683ca5f0>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-bd342450-2625-4d00-991d-cd0bf755cef2 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.104841 Apr 11 20:54:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 253/764] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 20:54:00 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-742296ea-5e7c-46ec-919e-abcf20bda690 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72684d9990>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-742296ea-5e7c-46ec-919e-abcf20bda690 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088136 Apr 11 20:54:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 254/765] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 20:54:00 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-eab87e5e-1550-4509-bc1c-7de49623752b tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f7268568f70>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-eab87e5e-1550-4509-bc1c-7de49623752b tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.080618 Apr 11 20:54:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 259/766] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 20:54:01 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-61acb1eb-8077-4222-940f-c8bada93e19c tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72683c9360>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-61acb1eb-8077-4222-940f-c8bada93e19c tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081999 Apr 11 20:54:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 254/767] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 20:54:01 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-9e87447c-7f02-49bc-941c-06aa83ac50a3 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f726839ce50>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-9e87447c-7f02-49bc-941c-06aa83ac50a3 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.097768 Apr 11 20:54:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 255/768] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 20:54:01 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-90028395-e152-4359-886c-e83a9206fa83 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72685c8a60>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-90028395-e152-4359-886c-e83a9206fa83 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084753 Apr 11 20:54:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 260/769] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 20:54:01 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a8070fa2-0358-43e7-b2e2-d208bd9210a8 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] Calling method '.version_select at 0x7f72683c8c10>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a8070fa2-0358-43e7-b2e2-d208bd9210a8 tempest-VolumesTestJSON-694058785 tempest-VolumesTestJSON-694058785-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085356 Apr 11 20:54:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 255/770] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 20:54:01 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=5 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=5 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:18 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:54:18 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-3623cccd-c1e1-47e8-81a9-aad29f62d16d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1702 microversion: 2.1 time: 0.366933 Apr 11 20:54:18 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 256/771] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:54:18 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1702 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=20 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:22 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:54:22 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-63654728-6b68-4c33-a833-92dcd07143bb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1556 microversion: 2.1 time: 0.163729 Apr 11 20:54:22 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 261/772] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:54:22 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:54:23 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:54:23 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7abf8ec6-fb0a-43b2-a48c-ca0455470b85 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1753 microversion: 2.87 time: 0.213950 Apr 11 20:54:23 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 256/773] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:54:23 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:31 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:54:31 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0750f4dc-fa5e-4254-93f1-80c7efe8384a tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1551 microversion: 2.1 time: 0.157664 Apr 11 20:54:31 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 257/774] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:54:31 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:45 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-99771a07-d18a-4de2-a4b8-fbab4f79350e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098168 Apr 11 20:54:45 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 262/775] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:54:45 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:46 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:54:46 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:46 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Creating event network-changed:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:54:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037230 Apr 11 20:54:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 257/776] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-0d6a960b-4cf1-40ea-8dd3-116e17da3fca tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/ips" status: 200 len: 107 microversion: 2.1 time: 0.043859 Apr 11 20:54:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 258/777] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 20:54:46 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/ips => generated 107 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "306a3747-1a8f-43b5-a496-9cb6ff82eae0"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282725 Apr 11 20:54:48 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 263/778] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 20:54:48 2023] POST /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:55 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'services' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:54:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments/306a3747-1a8f-43b5-a496-9cb6ff82eae0" status: 202 len: 0 microversion: 2.1 time: 0.164893 Apr 11 20:54:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 258/779] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:54:55 2023] DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments/306a3747-1a8f-43b5-a496-9cb6ff82eae0 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:54:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:54:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-baccc917-1251-4ff4-b794-3c75d9e1daaa tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Apr 11 20:54:55 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 259/780] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:54:55 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b while it is in vm_state rescued Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Request method failure captured: Apr 11 20:55:18 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments/15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 HTTP/1.1 Apr 11 20:55:18 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:55:18 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:55:18 user devstack@n-api.service[61907]: Connection: close Apr 11 20:55:18 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:55:18 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:55:18 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:55:18 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:55:18 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcZSFywGtwJwYWSkzx5Gu9ZYHnLHdOXo1DNiv8vMNmEPyDgdsGLfmPIBeHsa2fgNAuc5nMTC0wW4-67tbmU65_7sBh0J9OzjPA4a4B2gzdd5SyQszzI2yIgn9ii0IwH-EIN-fs7kCme2FERA5Ygy969w_kI_LeivqlfbVMbY3VHDiOk Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Project-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Tenant-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-User: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:55:18 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:55:18 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:55:18 user devstack@n-api.service[61907]: X-User-Id: dce0b6fa6d9546c8a04b7a4a5f93e0c7 Apr 11 20:55:18 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:55:18 user devstack@n-api.service[61907]: method: > Apr 11 20:55:18 user devstack@n-api.service[61907]: exception: Cannot 'detach_volume' instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b while it is in vm_state rescued Apr 11 20:55:18 user devstack@n-api.service[61907]: action_args: {'server_id': '3be648d4-6469-4c11-a51b-06c3fb4c9a6b', 'id': '15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230'} Apr 11 20:55:18 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b while it is in vm_state rescued Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b while it is in vm_state rescued Apr 11 20:55:18 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:55:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Returning 409 to user: Cannot 'detach_volume' instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b while it is in vm_state rescued {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:55:18 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-85766343-af70-492f-bb78-9f682beadcc6 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments/15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230" status: 409 len: 152 microversion: 2.1 time: 0.151792 Apr 11 20:55:18 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 264/781] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:55:18 2023] DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments/15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 20:55:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:18 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.087446 Apr 11 20:55:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 259/782] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:55:18 2023] POST /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=10 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:19 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-70cd0f3e-1fa9-4d0b-8ec2-15d90ba8e660 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1710 microversion: 2.1 time: 0.176087 Apr 11 20:55:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 260/783] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:55:19 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:55:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-unplugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Creating event network-vif-unplugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:55:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045307 Apr 11 20:55:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 265/784] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:22 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}, {"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:55:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:55:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062548 Apr 11 20:55:22 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 260/785] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/action" status: 204 len: 0 microversion: 2.1 time: 0.075658 Apr 11 20:55:23 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 261/786] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:55:22 2023] POST /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-75268806-4a13-44a2-a635-5004af11fede tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1556 microversion: 2.1 time: 0.203195 Apr 11 20:55:23 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 266/787] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:55:23 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:23 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/action" status: 202 len: 0 microversion: 2.87 time: 0.096050 Apr 11 20:55:23 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 261/788] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 20:55:23 2023] POST /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:23 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:23 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-cc5b1580-9b3f-41ca-a791-e44a3b35c40a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1761 microversion: 2.87 time: 0.203086 Apr 11 20:55:23 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 262/789] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:55:23 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1761 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:55:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-unplugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Creating event network-vif-unplugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:55:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034943 Apr 11 20:55:24 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 267/790] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:55:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036311 Apr 11 20:55:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 262/791] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}, {"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:55:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:55:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044219 Apr 11 20:55:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 263/792] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:28 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:55:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Apr 11 20:55:28 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 268/793] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Creating event network-changed:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:55:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:55:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Apr 11 20:55:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 264/794] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 204 len: 0 microversion: 2.1 time: 0.260134 Apr 11 20:55:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 263/795] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:55:32 2023] DELETE /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:33 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ffe52b5b-ab5e-47d6-bafb-b4d0306dc322 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 200 len: 1557 microversion: 2.1 time: 0.297420 Apr 11 20:55:33 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 269/796] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:55:33 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 1557 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:55:33 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-unplugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:33 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:33 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:33 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:33 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Creating event network-vif-unplugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:55:33 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031389 Apr 11 20:55:33 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 265/797] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-deleted", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] Creating event network-vif-deleted:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:55:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035887 Apr 11 20:55:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 264/798] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf9038-98d7-4312-8905-dba89af13ae4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Creating event network-vif-plugged:4eaf9038-98d7-4312-8905-dba89af13ae4 for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b on user Apr 11 20:55:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030561 Apr 11 20:55:35 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 270/799] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=14 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b389707d-f445-435b-bb88-fd83b5eed27b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046837 Apr 11 20:55:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 266/800] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:55:45 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:45 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:55:45 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 204 len: 0 microversion: 2.1 time: 0.119647 Apr 11 20:55:45 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 265/801] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:55:45 2023] DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=14 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:45 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "name": "network-vif-unplugged", "status": "completed", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Creating event network-vif-unplugged:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:55:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029677 Apr 11 20:55:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 267/802] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:46 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:55:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e98d0b07-1acc-47ce-99dd-e1f8a9fd873e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 200 len: 1669 microversion: 2.1 time: 0.715890 Apr 11 20:55:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 271/803] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:55:45 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 1669 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:55:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "name": "network-vif-deleted", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] Creating event network-vif-deleted:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:55:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027222 Apr 11 20:55:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 266/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:55:48 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073", "name": "network-vif-plugged", "status": "completed", "tag": "0c429f6b-6a13-4752-ab77-35aad97b9a10"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:55:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:55:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:55:48 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:55:48 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Creating event network-vif-plugged:0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 on user Apr 11 20:55:48 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028650 Apr 11 20:55:48 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 268/805] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=32 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:09 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:56:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-99f2caef-b2dd-476e-8de3-00a1ea6b9745 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1716 microversion: 2.1 time: 0.174955 Apr 11 20:56:09 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 272/806] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:09 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:13 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:56:13 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-904fb21e-6fde-47e4-aa94-48c9e284e9c2 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1548 microversion: 2.1 time: 0.250946 Apr 11 20:56:13 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 267/807] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:13 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1548 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=10 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:56:13 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:56:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d726b9a3-a084-479e-be8b-ec12dead82ad tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1767 microversion: 2.87 time: 0.250953 Apr 11 20:56:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 269/808] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:56:13 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1767 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] HTTP exception thrown: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Request method failure captured: Apr 11 20:56:23 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b HTTP/1.1 Apr 11 20:56:23 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:56:23 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:56:23 user devstack@n-api.service[61907]: Connection: close Apr 11 20:56:23 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:56:23 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:56:23 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:56:23 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:56:23 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcfovd142W1LczSzS55zfdOTUI2H-7h6n7I8xG33MqWzHvUolC3J4adL0Jd3NBXJOphkRbntcMsdr7Xp9CO-HTeG5t0qUz83sC23ypI6ffGVknl_S8QcVUQTDZeUkMQUYf8Lk069TJJmbZ9DevynCrdDznAzwCTI-BYhCBqpIXITSFU Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Project-Id: 2b26639cfda0489797dd5c7fbfc75927 Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestShelveInstance-1168874819 Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b26639cfda0489797dd5c7fbfc75927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b26639cfda0489797dd5c7fbfc75927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b26639cfda0489797dd5c7fbfc75927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Tenant: tempest-TestShelveInstance-1168874819 Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Tenant-Id: 2b26639cfda0489797dd5c7fbfc75927 Apr 11 20:56:23 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestShelveInstance-1168874819 Apr 11 20:56:23 user devstack@n-api.service[61907]: X-User: tempest-TestShelveInstance-1168874819-project-member Apr 11 20:56:23 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:56:23 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:56:23 user devstack@n-api.service[61907]: X-User-Id: f2ee47ef8e2248dda212a623eab9915b Apr 11 20:56:23 user devstack@n-api.service[61907]: X-User-Name: tempest-TestShelveInstance-1168874819-project-member Apr 11 20:56:23 user devstack@n-api.service[61907]: method: > Apr 11 20:56:23 user devstack@n-api.service[61907]: exception: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. Apr 11 20:56:23 user devstack@n-api.service[61907]: action_args: {'id': '93e7b2c8-565c-49ec-8dc2-c8a1489eab6b'} Apr 11 20:56:23 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. Apr 11 20:56:23 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:23 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Returning 404 to user: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:23 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-82ebd99e-d778-4d16-a387-4be1caca7419 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" status: 404 len: 111 microversion: 2.1 time: 0.049043 Apr 11 20:56:23 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 273/809] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:23 2023] GET /compute/v2.1/servers/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:23 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f94fe73c-2bde-4b94-82c1-3ecaa38e74c0 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Calling method '.version_select at 0x7f72683cb910>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:23 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:23 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f94fe73c-2bde-4b94-82c1-3ecaa38e74c0 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-176056509" status: 202 len: 0 microversion: 2.1 time: 0.029329 Apr 11 20:56:23 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 268/810] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 20:56:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-176056509 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:36 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 HTTP/1.1 Apr 11 20:56:36 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:56:36 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:56:36 user devstack@n-api.service[61909]: Connection: close Apr 11 20:56:36 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:56:36 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:56:36 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:56:36 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:56:36 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:36 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:36 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:36 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:56:36 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:56:36 user devstack@n-api.service[61909]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:36 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:36 user devstack@n-api.service[61909]: method: > Apr 11 20:56:36 user devstack@n-api.service[61909]: exception: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:36 user devstack@n-api.service[61909]: action_args: {'id': 'a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073'} Apr 11 20:56:36 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:36 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:36 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:36 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f4f89d0c-eb49-424c-926f-2e05e9f3b37e tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 404 len: 111 microversion: 2.1 time: 0.040550 Apr 11 20:56:36 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 270/811] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:36 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-087664b5-f078-4478-b95f-13a1fad8efb1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '.version_select at 0x7f72686d3400>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:36 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:36 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-087664b5-f078-4478-b95f-13a1fad8efb1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603118687" status: 202 len: 0 microversion: 2.1 time: 0.030500 Apr 11 20:56:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 274/812] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:56:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603118687 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:38 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 HTTP/1.1 Apr 11 20:56:38 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:56:38 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:56:38 user devstack@n-api.service[61908]: Connection: close Apr 11 20:56:38 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:56:38 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:56:38 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:56:38 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:56:38 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:38 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:38 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:38 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:56:38 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:56:38 user devstack@n-api.service[61908]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:38 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:38 user devstack@n-api.service[61908]: method: > Apr 11 20:56:38 user devstack@n-api.service[61908]: exception: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61908]: action_args: {'id': 'a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073'} Apr 11 20:56:38 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-108ee1ee-9594-43ea-b836-789fa1504a1d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 404 len: 111 microversion: 2.1 time: 0.032968 Apr 11 20:56:38 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 269/813] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:56:38 2023] DELETE /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:38 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 HTTP/1.1 Apr 11 20:56:38 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:56:38 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:56:38 user devstack@n-api.service[61909]: Connection: close Apr 11 20:56:38 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:56:38 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:56:38 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:56:38 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:56:38 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:38 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:38 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:38 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:56:38 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:56:38 user devstack@n-api.service[61909]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:38 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:38 user devstack@n-api.service[61909]: method: > Apr 11 20:56:38 user devstack@n-api.service[61909]: exception: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61909]: action_args: {'id': 'a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073'} Apr 11 20:56:38 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. Apr 11 20:56:38 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-860b8f54-8e5c-4b16-a175-9f86a2500ed2 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" status: 404 len: 111 microversion: 2.1 time: 0.042858 Apr 11 20:56:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 271/814] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:38 2023] GET /compute/v2.1/servers/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:39 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 HTTP/1.1 Apr 11 20:56:39 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:56:39 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:56:39 user devstack@n-api.service[61907]: Connection: close Apr 11 20:56:39 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:56:39 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:56:39 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:56:39 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:56:39 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61907]: method: > Apr 11 20:56:39 user devstack@n-api.service[61907]: exception: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: action_args: {'id': '7d336b76-477f-48c0-aa96-21b5d40d1754'} Apr 11 20:56:39 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-747c6bb1-9d80-415c-9c26-0f8e4fe4216f tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 404 len: 111 microversion: 2.1 time: 0.031763 Apr 11 20:56:39 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 275/815] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:56:39 2023] DELETE /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:39 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 HTTP/1.1 Apr 11 20:56:39 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:56:39 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:56:39 user devstack@n-api.service[61908]: Connection: close Apr 11 20:56:39 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:56:39 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:56:39 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:56:39 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:56:39 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61908]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:39 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61908]: method: > Apr 11 20:56:39 user devstack@n-api.service[61908]: exception: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61908]: action_args: {'id': '7d336b76-477f-48c0-aa96-21b5d40d1754'} Apr 11 20:56:39 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:39 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5ed6882a-f2c4-4425-a03c-99e61a0f821d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754" status: 404 len: 111 microversion: 2.1 time: 0.038777 Apr 11 20:56:39 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 270/816] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:39 2023] GET /compute/v2.1/servers/7d336b76-477f-48c0-aa96-21b5d40d1754 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:39 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 HTTP/1.1 Apr 11 20:56:39 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:56:39 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:56:39 user devstack@n-api.service[61909]: Connection: close Apr 11 20:56:39 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:56:39 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:56:39 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:56:39 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:56:39 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61909]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:39 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61909]: method: > Apr 11 20:56:39 user devstack@n-api.service[61909]: exception: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61909]: action_args: {'id': '5fd40faf-6ffa-40ff-b437-dd82717d9489'} Apr 11 20:56:39 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:39 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-2d6ce3f3-c04c-42e2-aab7-0e9128c41387 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 404 len: 111 microversion: 2.1 time: 0.030725 Apr 11 20:56:39 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 272/817] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:56:39 2023] DELETE /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:39 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 HTTP/1.1 Apr 11 20:56:39 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:56:39 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:56:39 user devstack@n-api.service[61907]: Connection: close Apr 11 20:56:39 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:56:39 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:56:39 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:56:39 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:56:39 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:39 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:39 user devstack@n-api.service[61907]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:39 user devstack@n-api.service[61907]: method: > Apr 11 20:56:39 user devstack@n-api.service[61907]: exception: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: action_args: {'id': '5fd40faf-6ffa-40ff-b437-dd82717d9489'} Apr 11 20:56:39 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. Apr 11 20:56:39 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:56:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-df059362-af7d-44ce-b816-10b4eaf6c07d tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489" status: 404 len: 111 microversion: 2.1 time: 0.038811 Apr 11 20:56:39 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 276/818] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:39 2023] GET /compute/v2.1/servers/5fd40faf-6ffa-40ff-b437-dd82717d9489 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:42 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e HTTP/1.1 Apr 11 20:56:42 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:56:42 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:56:42 user devstack@n-api.service[61908]: Connection: close Apr 11 20:56:42 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:56:42 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:56:42 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:56:42 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:56:42 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:42 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:42 user devstack@n-api.service[61908]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:42 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:56:42 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:56:42 user devstack@n-api.service[61908]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:42 user devstack@n-api.service[61908]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:42 user devstack@n-api.service[61908]: method: > Apr 11 20:56:42 user devstack@n-api.service[61908]: exception: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61908]: action_args: {'id': '645e96f7-547e-4eea-8523-7f7918c0ad3e'} Apr 11 20:56:42 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-e0f33209-e905-4e0c-8e02-e831eb14763c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 404 len: 111 microversion: 2.1 time: 0.033294 Apr 11 20:56:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 271/819] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:56:42 2023] DELETE /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:56:42 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HTTP exception thrown: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Request method failure captured: Apr 11 20:56:42 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e HTTP/1.1 Apr 11 20:56:42 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:56:42 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:56:42 user devstack@n-api.service[61909]: Connection: close Apr 11 20:56:42 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:56:42 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:56:42 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:56:42 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:56:42 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcY7iZoSAuE51XDLTZMk4Y1sGQjJKF4qIzRxUpxcx7kg67CiZVym1DYCEqqvEzq41QPoGiKMbOOn6PFQzkDx2zjV6an8rkZzm8We2maejO2vwqRVAfZbc0qlFNeF6XYVbS4TFHHFoTQ-FHnilO0G__MklDFxcnSqzS4jHmA2R--uO1s Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Project-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db28134878ba46528b7d5012ff9c7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Tenant: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Tenant-Id: db28134878ba46528b7d5012ff9c7aff Apr 11 20:56:42 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901377641 Apr 11 20:56:42 user devstack@n-api.service[61909]: X-User: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:42 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:56:42 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:56:42 user devstack@n-api.service[61909]: X-User-Id: 4f69b01612974865be4e1e1b6a9bd570 Apr 11 20:56:42 user devstack@n-api.service[61909]: X-User-Name: tempest-AttachVolumeNegativeTest-1901377641-project-member Apr 11 20:56:42 user devstack@n-api.service[61909]: method: > Apr 11 20:56:42 user devstack@n-api.service[61909]: exception: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61909]: action_args: {'id': '645e96f7-547e-4eea-8523-7f7918c0ad3e'} Apr 11 20:56:42 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. Apr 11 20:56:42 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:56:42 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Returning 404 to user: Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:56:42 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f864368e-5e78-4fff-8d0e-d14d0c263365 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e" status: 404 len: 111 microversion: 2.1 time: 0.029187 Apr 11 20:56:42 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 273/820] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:56:42 2023] GET /compute/v2.1/servers/645e96f7-547e-4eea-8523-7f7918c0ad3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1014581d-fa00-4d2b-9700-e2decdf54ddf tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.175798 Apr 11 20:57:09 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 277/821] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 20:57:09 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-interface => generated 283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:10 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:10 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Creating event network-changed:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:57:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176167 Apr 11 20:57:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 272/822] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:10 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'services' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:57:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments/15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230" status: 202 len: 0 microversion: 2.1 time: 0.215627 Apr 11 20:57:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 274/823] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:57:10 2023] DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments/15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:11 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:11 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d2f64531-1262-4a4a-955e-5414829f33b1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052881 Apr 11 20:57:11 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 278/824] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:57:11 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Creating event network-changed:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:57:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029012 Apr 11 20:57:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 273/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:13 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:57:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-4ef2e384-2e36-4d44-ac0c-4671c09eb3ea tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1548 microversion: 2.1 time: 0.314756 Apr 11 20:57:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 275/826] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:57:13 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1548 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:57:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:13 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:57:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/action" status: 200 len: 28420 microversion: 2.1 time: 0.220591 Apr 11 20:57:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 279/827] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:57:13 2023] POST /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/action => generated 28420 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:57:14 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 204 len: 0 microversion: 2.87 time: 0.219550 Apr 11 20:57:14 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 274/828] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:57:14 2023] DELETE /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:57:14 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:57:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b8834c47-f08a-4987-ac25-7e2caf45b822 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 200 len: 1773 microversion: 2.87 time: 0.197649 Apr 11 20:57:14 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 276/829] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:57:14 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 1773 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:57:14 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:57:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-befb39e2-a5d3-4883-9e6b-11d431928086 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670" status: 200 len: 1540 microversion: 2.1 time: 0.244392 Apr 11 20:57:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 280/830] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:57:14 2023] GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 => generated 1540 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-unplugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:14 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:14 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Creating event network-vif-unplugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:57:14 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083622 Apr 11 20:57:14 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 275/831] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-deleted", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] Creating event network-vif-deleted:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:57:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083592 Apr 11 20:57:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 277/832] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4cb65-5fee-46c2-8e8a-3cb846e963b0", "name": "network-vif-plugged", "status": "completed", "tag": "bc598d8b-b02e-429d-895b-c553ab0a415a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Creating event network-vif-plugged:bc598d8b-b02e-429d-895b-c553ab0a415a for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 on user Apr 11 20:57:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Apr 11 20:57:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 281/833] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:37 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:37 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-793939995", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "3538ee04-0bfc-4596-bb6f-d4e5082ee7d6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:37 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] validate_networks() for [('173a3c12-0c1e-4a4c-9682-6e5d62f61daa', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for user 3e34c9542bd64328a3c8d5cdb7421917 and project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 20:57:38 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3538ee04-0bfc-4596-bb6f-d4e5082ee7d6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 20:57:38 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.764018 Apr 11 20:57:38 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 276/834] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 20:57:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 20:57:38 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=10 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:38 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:38 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-47a838bc-da20-4723-acb0-87e1501633ba tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:57:38 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-47a838bc-da20-4723-acb0-87e1501633ba tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:57:38 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-47a838bc-da20-4723-acb0-87e1501633ba tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:57:38 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-47a838bc-da20-4723-acb0-87e1501633ba tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 200 len: 1051 microversion: 2.1 time: 0.081109 Apr 11 20:57:38 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 278/835] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:57:38 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 1051 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:57:41 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=10 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:41 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=22 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:41 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d", "tag": "1e785af1-7b60-43ee-a29c-9a9f377d7784"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Creating event network-changed:1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d on user Apr 11 20:57:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035050 Apr 11 20:57:41 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 282/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d", "name": "network-vif-plugged", "status": "completed", "tag": "1e785af1-7b60-43ee-a29c-9a9f377d7784"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Creating event network-vif-plugged:1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d on user Apr 11 20:57:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045221 Apr 11 20:57:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 277/837] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:57:54 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d", "name": "network-vif-plugged", "status": "completed", "tag": "1e785af1-7b60-43ee-a29c-9a9f377d7784"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:57:54 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:54 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:57:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:57:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:57:54 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:57:54 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Creating event network-vif-plugged:1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d on user Apr 11 20:57:54 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Apr 11 20:57:54 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 279/838] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:57:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-78dd848e-dc42-4aa0-8924-4f172bf50e36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051203 Apr 11 20:58:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 283/839] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:58:01 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:58:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 204 len: 0 microversion: 2.1 time: 0.116378 Apr 11 20:58:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 278/840] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:58:01 2023] DELETE /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b1006aa4-9f7d-4f66-a5a7-fa60c471e35f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 200 len: 1676 microversion: 2.1 time: 0.166549 Apr 11 20:58:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 280/841] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:58:01 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-unplugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:01 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Creating event network-vif-unplugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:58:01 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029748 Apr 11 20:58:01 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 284/842] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-deleted", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] Creating event network-vif-deleted:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:58:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040297 Apr 11 20:58:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 279/843] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:03 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be648d4-6469-4c11-a51b-06c3fb4c9a6b", "name": "network-vif-plugged", "status": "completed", "tag": "6cba1d9f-880d-4dbe-9315-db1ba21cb865"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:03 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Creating event network-vif-plugged:6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b on user Apr 11 20:58:03 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030573 Apr 11 20:58:03 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 281/844] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HTTP exception thrown: Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 could not be found. Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Request method failure captured: Apr 11 20:58:04 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 HTTP/1.1 Apr 11 20:58:04 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:58:04 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:58:04 user devstack@n-api.service[61907]: Connection: close Apr 11 20:58:04 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:58:04 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:58:04 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:58:04 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:58:04 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcWq1s7AXelQT_8wqMAYU-3Hm0MvHw_q_Ki1AeD50iSVzE2W7iOy90IdJrTbfILlgACGeaQkhBmANhw7FcnlwFU7LwsZ0RSYKvw0-FAqi6eJ38jEtHDVOBHICJ0ljKJTzTX-gy-QiqbrS14PULfyGX6isrGzVP7w_sY7BNbAufo2WvM Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Project-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Tenant-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:58:04 user devstack@n-api.service[61907]: X-User: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 20:58:04 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:58:04 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:58:04 user devstack@n-api.service[61907]: X-User-Id: 1d5cb62cc3844248be2e4456d970ccdf Apr 11 20:58:04 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 20:58:04 user devstack@n-api.service[61907]: method: > Apr 11 20:58:04 user devstack@n-api.service[61907]: exception: Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 could not be found. Apr 11 20:58:04 user devstack@n-api.service[61907]: action_args: {'id': 'ead4cb65-5fee-46c2-8e8a-3cb846e963b0'} Apr 11 20:58:04 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 could not be found. Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 could not be found. Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 could not be found. Apr 11 20:58:04 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:58:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Returning 404 to user: Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:58:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-18648561-dc06-49da-99ae-d9245759a88c tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0" status: 404 len: 111 microversion: 2.87 time: 0.031776 Apr 11 20:58:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 285/845] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:58:04 2023] GET /compute/v2.1/servers/ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:04 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:58:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" status: 204 len: 0 microversion: 2.87 time: 0.108338 Apr 11 20:58:04 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 280/846] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:58:04 2023] DELETE /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:05 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-daecbbda-ee10-4bdc-925d-51cc2369fbee tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" status: 200 len: 1695 microversion: 2.87 time: 0.223602 Apr 11 20:58:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 282/847] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:58:05 2023] GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => generated 1695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:58:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3", "name": "network-vif-unplugged", "status": "completed", "tag": "81b40e8f-efea-4c1a-8153-999d8b566b81"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Creating event network-vif-unplugged:81b40e8f-efea-4c1a-8153-999d8b566b81 for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 on user Apr 11 20:58:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043655 Apr 11 20:58:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 286/848] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:07 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3", "name": "network-vif-plugged", "status": "completed", "tag": "81b40e8f-efea-4c1a-8153-999d8b566b81"}, {"server_uuid": "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3", "name": "network-vif-deleted", "tag": "81b40e8f-efea-4c1a-8153-999d8b566b81"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:07 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:07 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:07 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:07 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Creating event network-vif-plugged:81b40e8f-efea-4c1a-8153-999d8b566b81 for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 on user Apr 11 20:58:07 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Creating event network-vif-deleted:81b40e8f-efea-4c1a-8153-999d8b566b81 for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 on user Apr 11 20:58:07 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038721 Apr 11 20:58:07 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 281/849] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:14 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:58:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 204 len: 0 microversion: 2.1 time: 0.118468 Apr 11 20:58:14 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 283/850] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:58:14 2023] DELETE /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:14 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-57755c52-6c98-4e63-a0a4-210806101960 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 200 len: 1554 microversion: 2.1 time: 0.179114 Apr 11 20:58:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 287/851] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:58:14 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:58:14 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-unplugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Creating event network-vif-unplugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:58:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037998 Apr 11 20:58:15 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 282/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-deleted", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] Creating event network-vif-deleted:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:58:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Apr 11 20:58:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 284/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6", "name": "network-vif-plugged", "status": "completed", "tag": "87a70211-de9a-40c1-b767-97cff2871ab3"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Creating event network-vif-plugged:87a70211-de9a-40c1-b767-97cff2871ab3 for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 on user Apr 11 20:58:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044459 Apr 11 20:58:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 288/854] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:29 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c3e9b5c8-0e66-4f32-9811-6fb0a74152cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 200 len: 1378 microversion: 2.1 time: 0.224069 Apr 11 20:58:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 283/855] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:58:28 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 1378 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] HTTP exception thrown: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b could not be found. Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Request method failure captured: Apr 11 20:58:51 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b HTTP/1.1 Apr 11 20:58:51 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:58:51 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:58:51 user devstack@n-api.service[61909]: Connection: close Apr 11 20:58:51 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:58:51 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:58:51 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:58:51 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:58:51 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcZSFywGtwJwYWSkzx5Gu9ZYHnLHdOXo1DNiv8vMNmEPyDgdsGLfmPIBeHsa2fgNAuc5nMTC0wW4-67tbmU65_7sBh0J9OzjPA4a4B2gzdd5SyQszzI2yIgn9ii0IwH-EIN-fs7kCme2FERA5Ygy969w_kI_LeivqlfbVMbY3VHDiOk Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Project-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Tenant-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-User: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:58:51 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:58:51 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:58:51 user devstack@n-api.service[61909]: X-User-Id: dce0b6fa6d9546c8a04b7a4a5f93e0c7 Apr 11 20:58:51 user devstack@n-api.service[61909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:58:51 user devstack@n-api.service[61909]: method: > Apr 11 20:58:51 user devstack@n-api.service[61909]: exception: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b could not be found. Apr 11 20:58:51 user devstack@n-api.service[61909]: action_args: {'id': '3be648d4-6469-4c11-a51b-06c3fb4c9a6b'} Apr 11 20:58:51 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b could not be found. Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b could not be found. Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b could not be found. Apr 11 20:58:51 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:58:51 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Returning 404 to user: Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:58:51 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-128452a7-7c23-45c8-accc-534dedb69cd0 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b" status: 404 len: 111 microversion: 2.1 time: 0.037914 Apr 11 20:58:51 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 285/856] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:58:51 2023] GET /compute/v2.1/servers/3be648d4-6469-4c11-a51b-06c3fb4c9a6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:58:51 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=12 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:51 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=20 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:51 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-2ceee2da-fa98-47f4-9924-402a88e702e4 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '.version_select at 0x7f7268568e50>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:51 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-2ceee2da-fa98-47f4-9924-402a88e702e4 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-440521057" status: 202 len: 0 microversion: 2.1 time: 0.027339 Apr 11 20:58:51 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 289/857] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 20:58:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-440521057 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HTTP exception thrown: Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 could not be found. Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Request method failure captured: Apr 11 20:58:55 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 HTTP/1.1 Apr 11 20:58:55 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:58:55 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:58:55 user devstack@n-api.service[61908]: Connection: close Apr 11 20:58:55 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:58:55 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:58:55 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:58:55 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:58:55 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcWq1s7AXelQT_8wqMAYU-3Hm0MvHw_q_Ki1AeD50iSVzE2W7iOy90IdJrTbfILlgACGeaQkhBmANhw7FcnlwFU7LwsZ0RSYKvw0-FAqi6eJ38jEtHDVOBHICJ0ljKJTzTX-gy-QiqbrS14PULfyGX6isrGzVP7w_sY7BNbAufo2WvM Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Project-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Tenant-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:58:55 user devstack@n-api.service[61908]: X-User: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 20:58:55 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:58:55 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:58:55 user devstack@n-api.service[61908]: X-User-Id: 1d5cb62cc3844248be2e4456d970ccdf Apr 11 20:58:55 user devstack@n-api.service[61908]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 20:58:55 user devstack@n-api.service[61908]: method: > Apr 11 20:58:55 user devstack@n-api.service[61908]: exception: Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 could not be found. Apr 11 20:58:55 user devstack@n-api.service[61908]: action_args: {'id': '9cd9582e-3d22-4d3d-8c25-e9274fbb55b3'} Apr 11 20:58:55 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 could not be found. Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 could not be found. Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 could not be found. Apr 11 20:58:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Returning 404 to user: Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:58:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-188c1aa2-f2d2-49e4-bec5-4885db3be363 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" status: 404 len: 111 microversion: 2.87 time: 0.039431 Apr 11 20:58:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 284/858] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:58:55 2023] GET /compute/v2.1/servers/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:58:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 204 len: 0 microversion: 2.87 time: 0.132650 Apr 11 20:58:55 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 286/859] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:58:55 2023] DELETE /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:55 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-4d28e2fa-3320-481a-9473-fe63b0678c55 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 200 len: 1773 microversion: 2.87 time: 0.179468 Apr 11 20:58:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 290/860] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:58:55 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 1773 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-unplugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Creating event network-vif-unplugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:58:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039581 Apr 11 20:58:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 285/861] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:56 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:58:56 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 204 len: 0 microversion: 2.1 time: 0.114055 Apr 11 20:58:56 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 287/862] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:58:56 2023] DELETE /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:57 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:58:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9dfff8a2-2066-4bdc-884e-745e3ce1cc4d tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 200 len: 1494 microversion: 2.1 time: 0.181512 Apr 11 20:58:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 291/863] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:58:56 2023] GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:58:57 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-deleted", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:57 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] Creating event network-vif-deleted:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:58:57 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035376 Apr 11 20:58:57 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 286/864] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097d9483-07ea-4dce-afd6-4d28dd0d2390", "name": "network-vif-plugged", "status": "completed", "tag": "4d88bcd7-9de8-4278-9490-d4c866efebc4"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-unplugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Creating event network-vif-plugged:4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 on user Apr 11 20:58:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Creating event network-vif-unplugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035391 Apr 11 20:58:57 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 288/865] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:57 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-deleted", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] Creating event network-vif-deleted:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028122 Apr 11 20:58:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 292/866] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:58:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-unplugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}, {"server_uuid": "764a059b-9ded-4d53-b960-ced4abe4323d", "name": "network-vif-plugged", "status": "completed", "tag": "4698b719-9a11-4eae-9a8d-d736723b13bb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:58:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:58:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:58:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:58:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Creating event network-vif-unplugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Creating event network-vif-plugged:4698b719-9a11-4eae-9a8d-d736723b13bb for instance 764a059b-9ded-4d53-b960-ced4abe4323d on user Apr 11 20:58:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.039500 Apr 11 20:58:59 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 287/867] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:58:59 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:59:04 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 HTTP/1.1 Apr 11 20:59:04 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:59:04 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:59:04 user devstack@n-api.service[61909]: Connection: close Apr 11 20:59:04 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:59:04 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:59:04 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:59:04 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:59:04 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:04 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:04 user devstack@n-api.service[61909]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:04 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:59:04 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:59:04 user devstack@n-api.service[61909]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:59:04 user devstack@n-api.service[61909]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:04 user devstack@n-api.service[61909]: method: > Apr 11 20:59:04 user devstack@n-api.service[61909]: exception: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:04 user devstack@n-api.service[61909]: action_args: {'id': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6'} Apr 11 20:59:04 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:04 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-5def55a9-49df-4eea-999d-f8735de50829 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 404 len: 111 microversion: 2.1 time: 0.028073 Apr 11 20:59:04 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 289/868] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:04 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:59:05 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 HTTP/1.1 Apr 11 20:59:05 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:59:05 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:59:05 user devstack@n-api.service[61907]: Connection: close Apr 11 20:59:05 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:59:05 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:59:05 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:59:05 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:59:05 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:05 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:05 user devstack@n-api.service[61907]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:05 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:59:05 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:59:05 user devstack@n-api.service[61907]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:59:05 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:05 user devstack@n-api.service[61907]: method: > Apr 11 20:59:05 user devstack@n-api.service[61907]: exception: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61907]: action_args: {'id': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6'} Apr 11 20:59:05 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-59266fb0-59c2-4de4-88be-15eecc577a4a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 404 len: 111 microversion: 2.1 time: 0.028203 Apr 11 20:59:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 293/869] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:59:04 2023] DELETE /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:59:05 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 HTTP/1.1 Apr 11 20:59:05 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:59:05 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:59:05 user devstack@n-api.service[61908]: Connection: close Apr 11 20:59:05 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:59:05 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:59:05 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:59:05 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:59:05 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:05 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:05 user devstack@n-api.service[61908]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:05 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:59:05 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:59:05 user devstack@n-api.service[61908]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:59:05 user devstack@n-api.service[61908]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:05 user devstack@n-api.service[61908]: method: > Apr 11 20:59:05 user devstack@n-api.service[61908]: exception: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61908]: action_args: {'id': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6'} Apr 11 20:59:05 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. Apr 11 20:59:05 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-b10e110c-8798-4f63-b277-7976f9f6646e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" status: 404 len: 111 microversion: 2.1 time: 0.032543 Apr 11 20:59:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 288/870] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:05 2023] GET /compute/v2.1/servers/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:59:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670" status: 204 len: 0 microversion: 2.1 time: 0.104055 Apr 11 20:59:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 290/871] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:59:05 2023] DELETE /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9468c609-59e5-4769-af28-cb2424f7d30a tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670" status: 200 len: 1546 microversion: 2.1 time: 0.163389 Apr 11 20:59:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 294/872] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:05 2023] GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "name": "network-vif-unplugged", "status": "completed", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:05 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Creating event network-vif-unplugged:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:59:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034270 Apr 11 20:59:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 289/873] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "name": "network-vif-deleted", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:06 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] Creating event network-vif-deleted:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:59:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030047 Apr 11 20:59:06 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 291/874] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27573de4-b3dc-48ad-b1dc-11c3cb206670", "name": "network-vif-plugged", "status": "completed", "tag": "a5b56921-0469-48f8-bbe7-b4106babb386"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Creating event network-vif-plugged:a5b56921-0469-48f8-bbe7-b4106babb386 for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 on user Apr 11 20:59:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 Apr 11 20:59:07 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 295/875] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9380280c-97f1-4a02-9e37-80f096364418 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 200 len: 1378 microversion: 2.1 time: 0.187545 Apr 11 20:59:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 290/876] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:29 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-cbda2d9d-408f-4d7e-94c2-421848e63bf9 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 200 len: 1378 microversion: 2.1 time: 0.162334 Apr 11 20:59:29 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 292/877] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:29 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 1378 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=24 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:59:29 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 204 len: 0 microversion: 2.1 time: 0.129775 Apr 11 20:59:29 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 296/878] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:59:29 2023] DELETE /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d", "name": "network-vif-unplugged", "status": "completed", "tag": "1e785af1-7b60-43ee-a29c-9a9f377d7784"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:29 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6d0c8339-4269-4ff8-aab4-b5cf8b7afe30 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 200 len: 1384 microversion: 2.1 time: 0.230546 Apr 11 20:59:29 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 291/879] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:29 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 1384 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:29 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Creating event network-vif-unplugged:1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d on user Apr 11 20:59:29 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029966 Apr 11 20:59:29 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 293/880] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:31 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d", "name": "network-vif-deleted", "tag": "1e785af1-7b60-43ee-a29c-9a9f377d7784"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:31 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] Creating event network-vif-deleted:1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d on user Apr 11 20:59:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Apr 11 20:59:31 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 297/881] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:31 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d", "name": "network-vif-plugged", "status": "completed", "tag": "1e785af1-7b60-43ee-a29c-9a9f377d7784"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:31 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Creating event network-vif-plugged:1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d on user Apr 11 20:59:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070083 Apr 11 20:59:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 292/882] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HTTP exception thrown: Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 could not be found. Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Request method failure captured: Apr 11 20:59:45 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 HTTP/1.1 Apr 11 20:59:45 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:59:45 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:59:45 user devstack@n-api.service[61909]: Connection: close Apr 11 20:59:45 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:59:45 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:59:45 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:59:45 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:59:45 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcWq1s7AXelQT_8wqMAYU-3Hm0MvHw_q_Ki1AeD50iSVzE2W7iOy90IdJrTbfILlgACGeaQkhBmANhw7FcnlwFU7LwsZ0RSYKvw0-FAqi6eJ38jEtHDVOBHICJ0ljKJTzTX-gy-QiqbrS14PULfyGX6isrGzVP7w_sY7BNbAufo2WvM Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Project-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Tenant-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 20:59:45 user devstack@n-api.service[61909]: X-User: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 20:59:45 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:59:45 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:59:45 user devstack@n-api.service[61909]: X-User-Id: 1d5cb62cc3844248be2e4456d970ccdf Apr 11 20:59:45 user devstack@n-api.service[61909]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 20:59:45 user devstack@n-api.service[61909]: method: > Apr 11 20:59:45 user devstack@n-api.service[61909]: exception: Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 could not be found. Apr 11 20:59:45 user devstack@n-api.service[61909]: action_args: {'id': '097d9483-07ea-4dce-afd6-4d28dd0d2390'} Apr 11 20:59:45 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 could not be found. Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 could not be found. Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 could not be found. Apr 11 20:59:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Returning 404 to user: Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-88d1958b-552c-4478-8177-b382619a0e14 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390" status: 404 len: 111 microversion: 2.87 time: 0.037297 Apr 11 20:59:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 294/883] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:59:45 2023] GET /compute/v2.1/servers/097d9483-07ea-4dce-afd6-4d28dd0d2390 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:46 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:59:46 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79" status: 204 len: 0 microversion: 2.87 time: 0.115629 Apr 11 20:59:46 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 298/884] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 20:59:46 2023] DELETE /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=14 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:46 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:46 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1c845e5a-b53c-4f71-9694-d8012a9935bf tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79" status: 200 len: 1695 microversion: 2.87 time: 0.204033 Apr 11 20:59:46 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 293/885] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 20:59:46 2023] GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:59:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d5f91c-afaa-456a-97e7-0460b1748d79", "name": "network-vif-unplugged", "status": "completed", "tag": "29039955-eab6-420c-aa2c-dbd6326814c4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Creating event network-vif-unplugged:29039955-eab6-420c-aa2c-dbd6326814c4 for instance f1d5f91c-afaa-456a-97e7-0460b1748d79 on user Apr 11 20:59:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031440 Apr 11 20:59:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 295/886] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d5f91c-afaa-456a-97e7-0460b1748d79", "name": "network-vif-deleted", "tag": "29039955-eab6-420c-aa2c-dbd6326814c4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] Creating event network-vif-deleted:29039955-eab6-420c-aa2c-dbd6326814c4 for instance f1d5f91c-afaa-456a-97e7-0460b1748d79 on user Apr 11 20:59:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Apr 11 20:59:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 294/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] HTTP exception thrown: Instance 764a059b-9ded-4d53-b960-ced4abe4323d could not be found. Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Request method failure captured: Apr 11 20:59:47 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d HTTP/1.1 Apr 11 20:59:47 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:59:47 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:59:47 user devstack@n-api.service[61907]: Connection: close Apr 11 20:59:47 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:59:47 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:59:47 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:59:47 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:59:47 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcZSFywGtwJwYWSkzx5Gu9ZYHnLHdOXo1DNiv8vMNmEPyDgdsGLfmPIBeHsa2fgNAuc5nMTC0wW4-67tbmU65_7sBh0J9OzjPA4a4B2gzdd5SyQszzI2yIgn9ii0IwH-EIN-fs7kCme2FERA5Ygy969w_kI_LeivqlfbVMbY3VHDiOk Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Project-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Tenant-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-User: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:59:47 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:59:47 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:59:47 user devstack@n-api.service[61907]: X-User-Id: dce0b6fa6d9546c8a04b7a4a5f93e0c7 Apr 11 20:59:47 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 20:59:47 user devstack@n-api.service[61907]: method: > Apr 11 20:59:47 user devstack@n-api.service[61907]: exception: Instance 764a059b-9ded-4d53-b960-ced4abe4323d could not be found. Apr 11 20:59:47 user devstack@n-api.service[61907]: action_args: {'id': '764a059b-9ded-4d53-b960-ced4abe4323d'} Apr 11 20:59:47 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764a059b-9ded-4d53-b960-ced4abe4323d could not be found. Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764a059b-9ded-4d53-b960-ced4abe4323d could not be found. Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764a059b-9ded-4d53-b960-ced4abe4323d could not be found. Apr 11 20:59:47 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Returning 404 to user: Instance 764a059b-9ded-4d53-b960-ced4abe4323d could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8352b436-de03-446f-93c2-2431f88c176a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d" status: 404 len: 111 microversion: 2.1 time: 0.257560 Apr 11 20:59:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 299/888] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:47 2023] GET /compute/v2.1/servers/764a059b-9ded-4d53-b960-ced4abe4323d => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:59:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 204 len: 0 microversion: 2.1 time: 0.126608 Apr 11 20:59:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 296/889] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:59:47 2023] DELETE /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:47 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:59:47 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-b032ec87-c289-4e81-850e-57f40cc6e55e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 200 len: 1509 microversion: 2.1 time: 0.230381 Apr 11 20:59:47 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 295/890] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:47 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:59:48 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d5f91c-afaa-456a-97e7-0460b1748d79", "name": "network-vif-plugged", "status": "completed", "tag": "29039955-eab6-420c-aa2c-dbd6326814c4"}, {"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-unplugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}, {"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-plugged", "status": "completed", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:48 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Creating event network-vif-plugged:29039955-eab6-420c-aa2c-dbd6326814c4 for instance f1d5f91c-afaa-456a-97e7-0460b1748d79 on user Apr 11 20:59:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Creating event network-vif-unplugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:59:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Creating event network-vif-plugged:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:59:48 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040134 Apr 11 20:59:48 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 300/891] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:48 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:49 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0405b-e73d-4c84-8208-21194ab434d2", "name": "network-vif-deleted", "tag": "730dc28f-1a82-4d35-af86-4a5744bd7ef0"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:59:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:49 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] Creating event network-vif-deleted:730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance 05f0405b-e73d-4c84-8208-21194ab434d2 on user Apr 11 20:59:49 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Apr 11 20:59:49 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 297/892] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:59:55 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 HTTP/1.1 Apr 11 20:59:55 user devstack@n-api.service[61908]: Accept: application/json Apr 11 20:59:55 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 20:59:55 user devstack@n-api.service[61908]: Connection: close Apr 11 20:59:55 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 20:59:55 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 20:59:55 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 20:59:55 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 20:59:55 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:55 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:55 user devstack@n-api.service[61908]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:55 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 20:59:55 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 20:59:55 user devstack@n-api.service[61908]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:59:55 user devstack@n-api.service[61908]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:55 user devstack@n-api.service[61908]: method: > Apr 11 20:59:55 user devstack@n-api.service[61908]: exception: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. Apr 11 20:59:55 user devstack@n-api.service[61908]: action_args: {'id': '27573de4-b3dc-48ad-b1dc-11c3cb206670'} Apr 11 20:59:55 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. Apr 11 20:59:55 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 20:59:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-142969b3-42a7-44da-bbbd-d771d71a0fb6 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670" status: 404 len: 111 microversion: 2.1 time: 0.028748 Apr 11 20:59:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 296/893] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:55 2023] GET /compute/v2.1/servers/27573de4-b3dc-48ad-b1dc-11c3cb206670 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:59:58 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 HTTP/1.1 Apr 11 20:59:58 user devstack@n-api.service[61907]: Accept: application/json Apr 11 20:59:58 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 20:59:58 user devstack@n-api.service[61907]: Connection: close Apr 11 20:59:58 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 20:59:58 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 20:59:58 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 20:59:58 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 20:59:58 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:58 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:58 user devstack@n-api.service[61907]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:58 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 20:59:58 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 20:59:58 user devstack@n-api.service[61907]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:59:58 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:58 user devstack@n-api.service[61907]: method: > Apr 11 20:59:58 user devstack@n-api.service[61907]: exception: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61907]: action_args: {'id': 'dadac585-3a7c-40d8-a335-fc2603588c28'} Apr 11 20:59:58 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:58 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-29648684-8249-4448-8fbd-7864b3d287f3 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 404 len: 111 microversion: 2.1 time: 0.041210 Apr 11 20:59:58 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 301/894] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:59:58 2023] DELETE /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:59:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HTTP exception thrown: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Request method failure captured: Apr 11 20:59:58 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 HTTP/1.1 Apr 11 20:59:58 user devstack@n-api.service[61909]: Accept: application/json Apr 11 20:59:58 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 20:59:58 user devstack@n-api.service[61909]: Connection: close Apr 11 20:59:58 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 20:59:58 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 20:59:58 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 20:59:58 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 20:59:58 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcSIv0BK0ZgLdT1FmVBHXY1fYc7OkXPW7P4KHtL6A8qelMnWT3bTNFvpuP6LfZN285g5ITxZGWiAFz6Hf_OdAfNH_2wwb3_w4ZJMiZdeUHryCTlkJXE0341nTvQblqF50CfZVoyFV4uUoSCfQ7rtwHlYQzdbyZHL3BSlppfar3A8jko Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Project-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d0c94dce35b4883940b8399d6d0ba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Tenant: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Tenant-Id: 9d0c94dce35b4883940b8399d6d0ba7e Apr 11 20:59:58 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServerActionsTestJSON-633772522 Apr 11 20:59:58 user devstack@n-api.service[61909]: X-User: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:58 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 20:59:58 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 20:59:58 user devstack@n-api.service[61909]: X-User-Id: 7736d32586e949e4839f826f18994a0f Apr 11 20:59:58 user devstack@n-api.service[61909]: X-User-Name: tempest-ServerActionsTestJSON-633772522-project-member Apr 11 20:59:58 user devstack@n-api.service[61909]: method: > Apr 11 20:59:58 user devstack@n-api.service[61909]: exception: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61909]: action_args: {'id': 'dadac585-3a7c-40d8-a335-fc2603588c28'} Apr 11 20:59:58 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. Apr 11 20:59:58 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 20:59:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Returning 404 to user: Instance dadac585-3a7c-40d8-a335-fc2603588c28 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:59:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-60e74d86-2c68-4f99-9374-35ce7967e9e0 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28" status: 404 len: 111 microversion: 2.1 time: 0.028986 Apr 11 20:59:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 298/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:59:58 2023] GET /compute/v2.1/servers/dadac585-3a7c-40d8-a335-fc2603588c28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:59:58 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-643a18cf-c452-4089-8a55-32a5d40d9cf5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Calling method '.version_select at 0x7f7268b1fd00>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:59:58 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-643a18cf-c452-4089-8a55-32a5d40d9cf5 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169091087" status: 202 len: 0 microversion: 2.1 time: 0.027518 Apr 11 20:59:58 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 297/896] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 20:59:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169091087 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:00:03 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-eb5332f1-3cd0-4559-b742-a9a988d2b2a1 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Action: 'create', calling method: .version_select at 0x7f72685c8310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1203135306"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-eb5332f1-3cd0-4559-b742-a9a988d2b2a1 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.414104 Apr 11 21:00:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 302/897] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 21:00:03 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 21:00:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-daeaec63-5cfd-4b27-af01-59228f18e234 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726839ea70>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:04 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-daeaec63-5cfd-4b27-af01-59228f18e234 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 200 len: 345 microversion: 2.1 time: 0.061371 Apr 11 21:00:04 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 299/898] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:04 2023] GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-7bbbf490-fb42-4527-bf92-eaa2ea2c1602 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726879e4d0>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7bbbf490-fb42-4527-bf92-eaa2ea2c1602 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 200 len: 346 microversion: 2.1 time: 0.091886 Apr 11 21:00:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 298/899] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:05 2023] GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b9024fa3-bde4-46af-bc06-4c6093fe2f71 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Action: 'create', calling method: .version_select at 0x7f72685c8430>, body: {"snapshot": {"volume_id": "0c2c7ce1-bb41-495f-91fc-c3de031f3f4c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-868545284"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b9024fa3-bde4-46af-bc06-4c6093fe2f71 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.250931 Apr 11 21:00:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 303/900] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 21:00:05 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:05 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-9ee67ee7-864d-4181-8aa5-c0b17c68c474 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f7268552e60>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-9ee67ee7-864d-4181-8aa5-c0b17c68c474 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90" status: 200 len: 286 microversion: 2.1 time: 0.041068 Apr 11 21:00:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 300/901] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:00:05 2023] GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:05 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=16 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-644c742e-8ea7-4b30-93c2-3f8f5d5ccb33 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726879e290>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-644c742e-8ea7-4b30-93c2-3f8f5d5ccb33 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.045149 Apr 11 21:00:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 299/902] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 21:00:05 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:05 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0e14402b-8f8f-4510-a129-4e322ac2729a tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726882bbe0>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:05 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0e14402b-8f8f-4510-a129-4e322ac2729a tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90" status: 200 len: 286 microversion: 2.1 time: 0.042359 Apr 11 21:00:05 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 304/903] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:00:05 2023] GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:06 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ceac614e-0b8b-41eb-9e72-8a4fba59a287 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726839e290>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:06 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ceac614e-0b8b-41eb-9e72-8a4fba59a287 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90" status: 200 len: 287 microversion: 2.1 time: 0.036982 Apr 11 21:00:06 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 301/904] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:00:06 2023] GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:06 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3483e718-db85-4965-b91e-3213ce75098a tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f72683c83a0>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:06 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3483e718-db85-4965-b91e-3213ce75098a tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90" status: 202 len: 0 microversion: 2.1 time: 0.071669 Apr 11 21:00:06 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 300/905] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 21:00:06 2023] DELETE /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:00:06 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-09230878-e60e-40ec-9514-8aceca2ef057 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726890a0e0>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-09230878-e60e-40ec-9514-8aceca2ef057 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90" status: 200 len: 286 microversion: 2.1 time: 0.034601 Apr 11 21:00:06 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 305/906] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:00:06 2023] GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cdaeaf58-a03f-49ce-b08b-2a6beb4ff868 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f7268551360>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-cdaeaf58-a03f-49ce-b08b-2a6beb4ff868 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] HTTP exception thrown: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. Apr 11 21:00:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cdaeaf58-a03f-49ce-b08b-2a6beb4ff868 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Request method failure captured: Apr 11 21:00:07 user devstack@n-api.service[61909]: request: GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 HTTP/1.1 Apr 11 21:00:07 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:00:07 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:00:07 user devstack@n-api.service[61909]: Connection: close Apr 11 21:00:07 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:00:07 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:00:07 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:00:07 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:00:07 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcpTqCyXsjFZwCf9kj12WKrupojipjPvlcP1_u6EBAL6G5-8-xn34RT8bZkwvaKKnw67S7UFa5o1Vvqxxs5r-pBAEUVP1znnhRZ0lRyJvd9kY2Q-qoD4-BDdul68YvNsbr94fLi7S57b7xAW0PkqEGpfozJjxGzttE2Ey_IYHidOiYs Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Project-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Tenant-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:07 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:07 user devstack@n-api.service[61909]: X-User: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:07 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:00:07 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:00:07 user devstack@n-api.service[61909]: X-User-Id: 12a3d606cffb47e1b24845083d91aba0 Apr 11 21:00:07 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:07 user devstack@n-api.service[61909]: method: Apr 11 21:00:07 user devstack@n-api.service[61909]: exception: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. Apr 11 21:00:07 user devstack@n-api.service[61909]: action_args: {'id': '48af3973-8c3b-4c87-ac2c-5fdab051ea90'} Apr 11 21:00:07 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. (HTTP 404) (Request-ID: req-0592a73d-0826-4e85-9152-7e061969375e) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. Apr 11 21:00:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-cdaeaf58-a03f-49ce-b08b-2a6beb4ff868 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Returning 404 to user: Snapshot 48af3973-8c3b-4c87-ac2c-5fdab051ea90 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-cdaeaf58-a03f-49ce-b08b-2a6beb4ff868 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90" status: 404 len: 111 microversion: 2.1 time: 0.038032 Apr 11 21:00:07 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 302/907] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:00:07 2023] GET /compute/v2.1/os-snapshots/48af3973-8c3b-4c87-ac2c-5fdab051ea90 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:07 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5c97c987-0787-4c9d-8f36-aa1e400a4dbf tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f7268b1e830>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:07 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5c97c987-0787-4c9d-8f36-aa1e400a4dbf tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 202 len: 0 microversion: 2.1 time: 0.065487 Apr 11 21:00:07 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 301/908] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:00:07 2023] DELETE /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:00:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-aa79184e-5f5e-46bb-b2d6-1fed8d9fb277 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726882a950>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:08 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-aa79184e-5f5e-46bb-b2d6-1fed8d9fb277 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 200 len: 345 microversion: 2.1 time: 0.058661 Apr 11 21:00:08 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 306/909] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:07 2023] GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:09 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:09 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:09 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f241c58a-aa4f-40b0-bf17-c13c30a0e412 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f7268553be0>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:09 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-f241c58a-aa4f-40b0-bf17-c13c30a0e412 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] HTTP exception thrown: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f241c58a-aa4f-40b0-bf17-c13c30a0e412 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Request method failure captured: Apr 11 21:00:09 user devstack@n-api.service[61909]: request: GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c HTTP/1.1 Apr 11 21:00:09 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:00:09 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:00:09 user devstack@n-api.service[61909]: Connection: close Apr 11 21:00:09 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:00:09 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:00:09 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:00:09 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:00:09 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcpTqCyXsjFZwCf9kj12WKrupojipjPvlcP1_u6EBAL6G5-8-xn34RT8bZkwvaKKnw67S7UFa5o1Vvqxxs5r-pBAEUVP1znnhRZ0lRyJvd9kY2Q-qoD4-BDdul68YvNsbr94fLi7S57b7xAW0PkqEGpfozJjxGzttE2Ey_IYHidOiYs Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Project-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Tenant-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:09 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61909]: X-User: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:09 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:00:09 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:00:09 user devstack@n-api.service[61909]: X-User-Id: 12a3d606cffb47e1b24845083d91aba0 Apr 11 21:00:09 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:09 user devstack@n-api.service[61909]: method: Apr 11 21:00:09 user devstack@n-api.service[61909]: exception: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61909]: action_args: {'id': '0c2c7ce1-bb41-495f-91fc-c3de031f3f4c'} Apr 11 21:00:09 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. (HTTP 404) (Request-ID: req-69274272-7ceb-4599-8d4c-452764b8ca87) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-f241c58a-aa4f-40b0-bf17-c13c30a0e412 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Returning 404 to user: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:09 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-f241c58a-aa4f-40b0-bf17-c13c30a0e412 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 404 len: 109 microversion: 2.1 time: 0.044284 Apr 11 21:00:09 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 303/910] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:09 2023] GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:09 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:09 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ff92631a-a0c6-49ec-826e-80cf1890afa2 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f72683cb760>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:09 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-ff92631a-a0c6-49ec-826e-80cf1890afa2 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] HTTP exception thrown: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ff92631a-a0c6-49ec-826e-80cf1890afa2 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Request method failure captured: Apr 11 21:00:09 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c HTTP/1.1 Apr 11 21:00:09 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:00:09 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:00:09 user devstack@n-api.service[61908]: Connection: close Apr 11 21:00:09 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:00:09 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:00:09 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:00:09 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:00:09 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcpTqCyXsjFZwCf9kj12WKrupojipjPvlcP1_u6EBAL6G5-8-xn34RT8bZkwvaKKnw67S7UFa5o1Vvqxxs5r-pBAEUVP1znnhRZ0lRyJvd9kY2Q-qoD4-BDdul68YvNsbr94fLi7S57b7xAW0PkqEGpfozJjxGzttE2Ey_IYHidOiYs Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Project-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Tenant-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:09 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61908]: X-User: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:09 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:00:09 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:00:09 user devstack@n-api.service[61908]: X-User-Id: 12a3d606cffb47e1b24845083d91aba0 Apr 11 21:00:09 user devstack@n-api.service[61908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:09 user devstack@n-api.service[61908]: method: Apr 11 21:00:09 user devstack@n-api.service[61908]: exception: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61908]: action_args: {'id': '0c2c7ce1-bb41-495f-91fc-c3de031f3f4c'} Apr 11 21:00:09 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. (HTTP 404) (Request-ID: req-acfd1b25-9cb3-43e3-b9ce-e71c0e5472f4) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ff92631a-a0c6-49ec-826e-80cf1890afa2 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Returning 404 to user: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:09 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ff92631a-a0c6-49ec-826e-80cf1890afa2 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 404 len: 109 microversion: 2.1 time: 0.051036 Apr 11 21:00:09 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 302/911] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:00:09 2023] DELETE /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b2356580-ab79-4442-a5ef-9c8f4bc93803 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Calling method '.version_select at 0x7f726856a830>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-b2356580-ab79-4442-a5ef-9c8f4bc93803 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] HTTP exception thrown: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b2356580-ab79-4442-a5ef-9c8f4bc93803 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Request method failure captured: Apr 11 21:00:09 user devstack@n-api.service[61907]: request: GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c HTTP/1.1 Apr 11 21:00:09 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:00:09 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:00:09 user devstack@n-api.service[61907]: Connection: close Apr 11 21:00:09 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:00:09 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:00:09 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:00:09 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:00:09 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcpTqCyXsjFZwCf9kj12WKrupojipjPvlcP1_u6EBAL6G5-8-xn34RT8bZkwvaKKnw67S7UFa5o1Vvqxxs5r-pBAEUVP1znnhRZ0lRyJvd9kY2Q-qoD4-BDdul68YvNsbr94fLi7S57b7xAW0PkqEGpfozJjxGzttE2Ey_IYHidOiYs Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Project-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6403d3dd10af43399ccc2b7f5ea9a3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Tenant-Id: 6403d3dd10af43399ccc2b7f5ea9a3ff Apr 11 21:00:09 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479167120 Apr 11 21:00:09 user devstack@n-api.service[61907]: X-User: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:09 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:00:09 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:00:09 user devstack@n-api.service[61907]: X-User-Id: 12a3d606cffb47e1b24845083d91aba0 Apr 11 21:00:09 user devstack@n-api.service[61907]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479167120-project-member Apr 11 21:00:09 user devstack@n-api.service[61907]: method: Apr 11 21:00:09 user devstack@n-api.service[61907]: exception: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61907]: action_args: {'id': '0c2c7ce1-bb41-495f-91fc-c3de031f3f4c'} Apr 11 21:00:09 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. (HTTP 404) (Request-ID: req-8817beac-8f89-464b-b4ba-a30bfb89c210) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. Apr 11 21:00:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b2356580-ab79-4442-a5ef-9c8f4bc93803 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] Returning 404 to user: Volume 0c2c7ce1-bb41-495f-91fc-c3de031f3f4c could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b2356580-ab79-4442-a5ef-9c8f4bc93803 tempest-VolumesSnapshotsTestJSON-479167120 tempest-VolumesSnapshotsTestJSON-479167120-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c" status: 404 len: 109 microversion: 2.1 time: 0.037193 Apr 11 21:00:09 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 307/912] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:09 2023] GET /compute/v2.1/os-volumes/0c2c7ce1-bb41-495f-91fc-c3de031f3f4c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-467b91be-c6ab-47ce-9b32-2c669167b2b6 tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Action: 'create', calling method: .version_select at 0x7f7268551480>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-125860129", "metadata": {"Type": "work"}}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-467b91be-c6ab-47ce-9b32-2c669167b2b6 tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.481354 Apr 11 21:00:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 304/913] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 21:00:10 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 483 msecs (HTTP/1.1 200) 10 headers in 447 bytes (2 switches on core 0) Apr 11 21:00:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ddcff719-2be1-41f3-8b58-d56228afc43f tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Calling method '.version_select at 0x7f72683c91b0>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ddcff719-2be1-41f3-8b58-d56228afc43f tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f" status: 200 len: 352 microversion: 2.1 time: 0.051250 Apr 11 21:00:11 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 303/914] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:11 2023] GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9936dd99-ecd1-4822-a962-d6e23de5854e tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Calling method '.version_select at 0x7f72685c9c60>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9936dd99-ecd1-4822-a962-d6e23de5854e tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f" status: 200 len: 353 microversion: 2.1 time: 0.052714 Apr 11 21:00:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 308/915] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:12 2023] GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ca862f0a-a0ac-4976-9e83-02b51ad03647 tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Calling method '.version_select at 0x7f72686c1090>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ca862f0a-a0ac-4976-9e83-02b51ad03647 tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f" status: 200 len: 353 microversion: 2.1 time: 0.081210 Apr 11 21:00:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 305/916] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:12 2023] GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:12 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9bde6f1d-edef-4d62-95db-be1bad52c534 tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Calling method '.version_select at 0x7f726841d360>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9bde6f1d-edef-4d62-95db-be1bad52c534 tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f" status: 202 len: 0 microversion: 2.1 time: 0.063896 Apr 11 21:00:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 304/917] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:00:12 2023] DELETE /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:00:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-7858768c-6f10-40eb-bc52-e9dfa3acc5bf tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Calling method '.version_select at 0x7f72685cac20>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-7858768c-6f10-40eb-bc52-e9dfa3acc5bf tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f" status: 200 len: 352 microversion: 2.1 time: 0.046892 Apr 11 21:00:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 309/918] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:12 2023] GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4877b373-11e1-43bf-a4f8-e96499b8d14a tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Calling method '.version_select at 0x7f72686c1990>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-4877b373-11e1-43bf-a4f8-e96499b8d14a tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] HTTP exception thrown: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. Apr 11 21:00:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4877b373-11e1-43bf-a4f8-e96499b8d14a tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Request method failure captured: Apr 11 21:00:13 user devstack@n-api.service[61909]: request: GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f HTTP/1.1 Apr 11 21:00:13 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:00:13 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:00:13 user devstack@n-api.service[61909]: Connection: close Apr 11 21:00:13 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:00:13 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:00:13 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:00:13 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:00:13 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcpaTB_wD__I5QT8wbt5rXOwR8ClQZpfkhTFTaUdEv5RqW4owcEVVao40RIuGa7eQwmtjKoXEltPGRnbYmpHbsPeJqMX9EP74hInQo-NTlYWn6hu_FtJE4LU9duvQRXSML8PRErrQjxzNknTUnuO6fnwI5N_cWJbMquDx8ClkqfJ7Bg Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Project-Id: 226ef1e8be7149b8826d5215aa81f5b4 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesGetTestJSON-1187532074 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/226ef1e8be7149b8826d5215aa81f5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/226ef1e8be7149b8826d5215aa81f5b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/226ef1e8be7149b8826d5215aa81f5b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesGetTestJSON-1187532074 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Tenant-Id: 226ef1e8be7149b8826d5215aa81f5b4 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesGetTestJSON-1187532074 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-User: tempest-VolumesGetTestJSON-1187532074-project-member Apr 11 21:00:13 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:00:13 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:00:13 user devstack@n-api.service[61909]: X-User-Id: 9d8e241906f74b749c5e38e024ab92c5 Apr 11 21:00:13 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesGetTestJSON-1187532074-project-member Apr 11 21:00:13 user devstack@n-api.service[61909]: method: Apr 11 21:00:13 user devstack@n-api.service[61909]: exception: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. Apr 11 21:00:13 user devstack@n-api.service[61909]: action_args: {'id': '2e21d260-1093-45f7-8271-813a354f4d0f'} Apr 11 21:00:13 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. (HTTP 404) (Request-ID: req-1ac9ebf4-0181-4ddf-9964-d785e9c22ba2) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. Apr 11 21:00:13 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4877b373-11e1-43bf-a4f8-e96499b8d14a tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] Returning 404 to user: Volume 2e21d260-1093-45f7-8271-813a354f4d0f could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-4877b373-11e1-43bf-a4f8-e96499b8d14a tempest-VolumesGetTestJSON-1187532074 tempest-VolumesGetTestJSON-1187532074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f" status: 404 len: 109 microversion: 2.1 time: 0.043390 Apr 11 21:00:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 306/919] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:00:13 2023] GET /compute/v2.1/os-volumes/2e21d260-1093-45f7-8271-813a354f4d0f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1807635275", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "3a5877aa-381a-454b-a3d2-3d9acc75413a"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] validate_networks() for [('3a5877aa-381a-454b-a3d2-3d9acc75413a', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Getting quotas for project 9b0794c4a442430b8fc1faf0bd1ee1ca. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Getting quotas for user c721a6b00fdd479eaf8634f51e4a1b13 and project 9b0794c4a442430b8fc1faf0bd1ee1ca. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:00:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:00:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.613905 Apr 11 21:00:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 305/920] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:00:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:00:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-17d88c92-ec44-4523-b6d9-3c9ae843583a tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-17d88c92-ec44-4523-b6d9-3c9ae843583a tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:19 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-17d88c92-ec44-4523-b6d9-3c9ae843583a tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c721a6b00fdd479eaf8634f51e4a1b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0794c4a442430b8fc1faf0bd1ee1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:00:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-17d88c92-ec44-4523-b6d9-3c9ae843583a tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0" status: 200 len: 1208 microversion: 2.1 time: 0.065457 Apr 11 21:00:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 310/921] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:00:19 2023] GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0 => generated 1208 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:00:19 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d HTTP/1.1 Apr 11 21:00:19 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:00:19 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:00:19 user devstack@n-api.service[61909]: Connection: close Apr 11 21:00:19 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:00:19 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:00:19 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:00:19 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:00:19 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:00:19 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:00:19 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:00:19 user devstack@n-api.service[61909]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:00:19 user devstack@n-api.service[61909]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:00:19 user devstack@n-api.service[61909]: method: > Apr 11 21:00:19 user devstack@n-api.service[61909]: exception: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:19 user devstack@n-api.service[61909]: action_args: {'id': 'b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d'} Apr 11 21:00:19 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:19 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8f27e8b8-c7a1-473b-910d-d96a72d6c228 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 404 len: 111 microversion: 2.1 time: 0.032632 Apr 11 21:00:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 307/922] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:00:19 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:00:20 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d HTTP/1.1 Apr 11 21:00:20 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:00:20 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:00:20 user devstack@n-api.service[61908]: Connection: close Apr 11 21:00:20 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:00:20 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:00:20 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:00:20 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:00:20 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:00:20 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:00:20 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:00:20 user devstack@n-api.service[61908]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:00:20 user devstack@n-api.service[61908]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:00:20 user devstack@n-api.service[61908]: method: > Apr 11 21:00:20 user devstack@n-api.service[61908]: exception: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61908]: action_args: {'id': 'b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d'} Apr 11 21:00:20 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:20 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-80f5648d-db75-4239-9d6a-754975c67a6f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 404 len: 111 microversion: 2.1 time: 0.035487 Apr 11 21:00:20 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 306/923] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:00:20 2023] DELETE /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:00:20 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d HTTP/1.1 Apr 11 21:00:20 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:00:20 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:00:20 user devstack@n-api.service[61907]: Connection: close Apr 11 21:00:20 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:00:20 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:00:20 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:00:20 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:00:20 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:00:20 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:00:20 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:00:20 user devstack@n-api.service[61907]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:00:20 user devstack@n-api.service[61907]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:00:20 user devstack@n-api.service[61907]: method: > Apr 11 21:00:20 user devstack@n-api.service[61907]: exception: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61907]: action_args: {'id': 'b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d'} Apr 11 21:00:20 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. Apr 11 21:00:20 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-16090d5c-7173-4883-9a34-dc1c9564c1cc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" status: 404 len: 111 microversion: 2.1 time: 0.028603 Apr 11 21:00:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 311/924] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:00:20 2023] GET /compute/v2.1/servers/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:21 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13e0c74-2071-482a-a2e9-03ea7182b9f0", "tag": "62239930-fb45-440e-8376-081e29157258"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:21 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Creating event network-changed:62239930-fb45-440e-8376-081e29157258 for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 on user Apr 11 21:00:21 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037743 Apr 11 21:00:21 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 308/925] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0c74-2071-482a-a2e9-03ea7182b9f0", "name": "network-vif-plugged", "status": "completed", "tag": "62239930-fb45-440e-8376-081e29157258"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Creating event network-vif-plugged:62239930-fb45-440e-8376-081e29157258 for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 on user Apr 11 21:00:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037487 Apr 11 21:00:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 307/926] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-222867129", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa"}]}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] validate_networks() for [('173a3c12-0c1e-4a4c-9682-6e5d62f61daa', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for user 3e34c9542bd64328a3c8d5cdb7421917 and project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:00:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd',volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:00:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.801804 Apr 11 21:00:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 312/927] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:00:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:00:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-7562c887-258c-4b68-9ea3-d22d3700e31d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:25 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-7562c887-258c-4b68-9ea3-d22d3700e31d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:25 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-7562c887-258c-4b68-9ea3-d22d3700e31d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:00:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-7562c887-258c-4b68-9ea3-d22d3700e31d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 200 len: 1065 microversion: 2.1 time: 0.068218 Apr 11 21:00:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 309/928] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:00:25 2023] GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 1065 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 21:00:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0c74-2071-482a-a2e9-03ea7182b9f0", "name": "network-vif-plugged", "status": "completed", "tag": "62239930-fb45-440e-8376-081e29157258"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Creating event network-vif-plugged:62239930-fb45-440e-8376-081e29157258 for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 on user Apr 11 21:00:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029682 Apr 11 21:00:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 308/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:28 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6eb5a48-11e6-4d15-a10e-41a3067944a2", "tag": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Creating event network-changed:4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 on user Apr 11 21:00:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 Apr 11 21:00:28 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 313/930] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:34 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:34 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb5a48-11e6-4d15-a10e-41a3067944a2", "name": "network-vif-plugged", "status": "completed", "tag": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:34 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:34 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Creating event network-vif-plugged:4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 on user Apr 11 21:00:34 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042044 Apr 11 21:00:34 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 310/931] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb5a48-11e6-4d15-a10e-41a3067944a2", "name": "network-vif-plugged", "status": "completed", "tag": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:36 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Creating event network-vif-plugged:4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 on user Apr 11 21:00:36 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044093 Apr 11 21:00:36 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 309/932] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HTTP exception thrown: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Request method failure captured: Apr 11 21:00:36 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 HTTP/1.1 Apr 11 21:00:36 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:00:36 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:00:36 user devstack@n-api.service[61907]: Connection: close Apr 11 21:00:36 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:00:36 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:00:36 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:00:36 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:00:36 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcWq1s7AXelQT_8wqMAYU-3Hm0MvHw_q_Ki1AeD50iSVzE2W7iOy90IdJrTbfILlgACGeaQkhBmANhw7FcnlwFU7LwsZ0RSYKvw0-FAqi6eJ38jEtHDVOBHICJ0ljKJTzTX-gy-QiqbrS14PULfyGX6isrGzVP7w_sY7BNbAufo2WvM Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Project-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85bf8fe34838426ea05060463458e5e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Tenant-Id: 85bf8fe34838426ea05060463458e5e0 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500 Apr 11 21:00:36 user devstack@n-api.service[61907]: X-User: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 21:00:36 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:00:36 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:00:36 user devstack@n-api.service[61907]: X-User-Id: 1d5cb62cc3844248be2e4456d970ccdf Apr 11 21:00:36 user devstack@n-api.service[61907]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member Apr 11 21:00:36 user devstack@n-api.service[61907]: method: > Apr 11 21:00:36 user devstack@n-api.service[61907]: exception: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. Apr 11 21:00:36 user devstack@n-api.service[61907]: action_args: {'id': 'f1d5f91c-afaa-456a-97e7-0460b1748d79'} Apr 11 21:00:36 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. Apr 11 21:00:36 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:00:36 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Returning 404 to user: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-28bf8ef7-9a07-424f-b1a1-c570e7853be3 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79" status: 404 len: 111 microversion: 2.87 time: 0.045635 Apr 11 21:00:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 314/933] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:00:36 2023] GET /compute/v2.1/servers/f1d5f91c-afaa-456a-97e7-0460b1748d79 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] HTTP exception thrown: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 could not be found. Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Request method failure captured: Apr 11 21:00:37 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 HTTP/1.1 Apr 11 21:00:37 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:00:37 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:00:37 user devstack@n-api.service[61909]: Connection: close Apr 11 21:00:37 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:00:37 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:00:37 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:00:37 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:00:37 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcZSFywGtwJwYWSkzx5Gu9ZYHnLHdOXo1DNiv8vMNmEPyDgdsGLfmPIBeHsa2fgNAuc5nMTC0wW4-67tbmU65_7sBh0J9OzjPA4a4B2gzdd5SyQszzI2yIgn9ii0IwH-EIN-fs7kCme2FERA5Ygy969w_kI_LeivqlfbVMbY3VHDiOk Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Project-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2ad2f73c14141dd8f7aa0d6f6c747b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Tenant-Id: a2ad2f73c14141dd8f7aa0d6f6c747b0 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777351805 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-User: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 21:00:37 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:00:37 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:00:37 user devstack@n-api.service[61909]: X-User-Id: dce0b6fa6d9546c8a04b7a4a5f93e0c7 Apr 11 21:00:37 user devstack@n-api.service[61909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777351805-project-member Apr 11 21:00:37 user devstack@n-api.service[61909]: method: > Apr 11 21:00:37 user devstack@n-api.service[61909]: exception: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 could not be found. Apr 11 21:00:37 user devstack@n-api.service[61909]: action_args: {'id': '05f0405b-e73d-4c84-8208-21194ab434d2'} Apr 11 21:00:37 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 could not be found. Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 could not be found. Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 could not be found. Apr 11 21:00:37 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:00:37 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Returning 404 to user: Instance 05f0405b-e73d-4c84-8208-21194ab434d2 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:00:37 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-39bab8d3-fa7c-4b3f-b236-c1145229a63a tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2" status: 404 len: 111 microversion: 2.1 time: 0.035417 Apr 11 21:00:37 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 311/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:00:37 2023] GET /compute/v2.1/servers/05f0405b-e73d-4c84-8208-21194ab434d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:00:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-857833810", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "b786d8af-e6ba-41ff-8577-3472f89d17f0"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:49 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] validate_networks() for [('b786d8af-e6ba-41ff-8577-3472f89d17f0', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Getting quotas for project cf42a499ff3c43afaea1b716c0e801ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Getting quotas for user 8557484fdf27419384420c986b776a90 and project cf42a499ff3c43afaea1b716c0e801ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:00:50 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:00:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.082108 Apr 11 21:00:50 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 310/935] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:00:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:00:50 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:50 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-ed6a6c61-b5dd-4312-a7d0-8d90a2c618d2 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:00:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-ed6a6c61-b5dd-4312-a7d0-8d90a2c618d2 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:00:50 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-ed6a6c61-b5dd-4312-a7d0-8d90a2c618d2 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:00:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-ed6a6c61-b5dd-4312-a7d0-8d90a2c618d2 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1210 microversion: 2.1 time: 0.285539 Apr 11 21:00:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 315/936] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:00:50 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1210 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:00:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0171d4-fddd-424b-9b11-9f78723f3c1b", "tag": "3a08d9a8-9b94-4131-b609-11988264e1a8"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:00:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Creating event network-changed:3a08d9a8-9b94-4131-b609-11988264e1a8 for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b on user Apr 11 21:00:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038457 Apr 11 21:00:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 312/937] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0171d4-fddd-424b-9b11-9f78723f3c1b", "name": "network-vif-plugged", "status": "completed", "tag": "3a08d9a8-9b94-4131-b609-11988264e1a8"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Creating event network-vif-plugged:3a08d9a8-9b94-4131-b609-11988264e1a8 for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b on user Apr 11 21:00:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056641 Apr 11 21:00:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 311/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:00:57 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0171d4-fddd-424b-9b11-9f78723f3c1b", "name": "network-vif-plugged", "status": "completed", "tag": "3a08d9a8-9b94-4131-b609-11988264e1a8"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:00:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:00:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:00:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:00:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Creating event network-vif-plugged:3a08d9a8-9b94-4131-b609-11988264e1a8 for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b on user Apr 11 21:00:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029323 Apr 11 21:00:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 316/939] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2046167664", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] validate_networks() for None {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:04 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:05 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Getting quotas for project 90afd2eb3cec40029264c2f35b2546a3. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:01:05 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Getting quotas for user 57f22d3582bd4d2da3b18d2d0b68c29b and project 90afd2eb3cec40029264c2f35b2546a3. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:01:05 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:01:05 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:01:05 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.409146 Apr 11 21:01:05 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 313/940] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:01:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5c045baf-252f-46d3-8f8d-e38252726de9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5c045baf-252f-46d3-8f8d-e38252726de9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:05 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-5c045baf-252f-46d3-8f8d-e38252726de9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f22d3582bd4d2da3b18d2d0b68c29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90afd2eb3cec40029264c2f35b2546a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:01:05 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5c045baf-252f-46d3-8f8d-e38252726de9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667" status: 200 len: 1209 microversion: 2.1 time: 0.107230 Apr 11 21:01:05 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 312/941] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:01:05 2023] GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de6fbc5-8846-4975-9ee4-3b554e1fd667", "tag": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:07 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Creating event network-changed:eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 on user Apr 11 21:01:07 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035536 Apr 11 21:01:07 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 317/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:01:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:09 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c721a6b00fdd479eaf8634f51e4a1b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0794c4a442430b8fc1faf0bd1ee1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:01:09 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-03d1f4bf-4cd7-4eaf-896c-f2e6ab69e3c1 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0" status: 200 len: 1485 microversion: 2.1 time: 0.170877 Apr 11 21:01:09 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 314/943] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:01:09 2023] GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0 => generated 1485 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:01:09 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de6fbc5-8846-4975-9ee4-3b554e1fd667", "name": "network-vif-plugged", "status": "completed", "tag": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:01:09 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:09 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:09 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:09 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Creating event network-vif-plugged:eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 on user Apr 11 21:01:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Apr 11 21:01:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 313/944] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:01:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:01:12 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de6fbc5-8846-4975-9ee4-3b554e1fd667", "name": "network-vif-plugged", "status": "completed", "tag": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:01:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:12 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Creating event network-vif-plugged:eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 on user Apr 11 21:01:12 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029743 Apr 11 21:01:12 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 318/945] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:01:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:16 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:01:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-53329d97-acda-4b00-9213-0a3d94e43ed3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 200 len: 1392 microversion: 2.1 time: 0.241153 Apr 11 21:01:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 315/946] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:01:16 2023] GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:40 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:41 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:01:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cb68d024-3621-4737-87f0-1d26c3f800f3 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1494 microversion: 2.1 time: 0.288342 Apr 11 21:01:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 314/947] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:01:40 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1494 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:01:55 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f22d3582bd4d2da3b18d2d0b68c29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90afd2eb3cec40029264c2f35b2546a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:01:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-a2c70311-b69c-4ffc-9b9c-22ec5cc982de tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667" status: 200 len: 1454 microversion: 2.1 time: 0.154811 Apr 11 21:01:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 319/948] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:01:55 2023] GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=14 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:13 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:02:13 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0" status: 204 len: 0 microversion: 2.1 time: 0.156556 Apr 11 21:02:13 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 316/949] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:02:13 2023] DELETE /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:13 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c721a6b00fdd479eaf8634f51e4a1b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0794c4a442430b8fc1faf0bd1ee1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:02:13 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-cc0d06c9-8c93-4a00-9545-210676f8e507 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0" status: 200 len: 1491 microversion: 2.1 time: 0.238096 Apr 11 21:02:13 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 315/950] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:02:13 2023] GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0 => generated 1491 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:02:13 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:13 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0c74-2071-482a-a2e9-03ea7182b9f0", "name": "network-vif-unplugged", "status": "completed", "tag": "62239930-fb45-440e-8376-081e29157258"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:13 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Creating event network-vif-unplugged:62239930-fb45-440e-8376-081e29157258 for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 on user Apr 11 21:02:13 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084218 Apr 11 21:02:13 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 320/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:14 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0c74-2071-482a-a2e9-03ea7182b9f0", "name": "network-vif-deleted", "tag": "62239930-fb45-440e-8376-081e29157258"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] Creating event network-vif-deleted:62239930-fb45-440e-8376-081e29157258 for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 on user Apr 11 21:02:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 Apr 11 21:02:14 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 317/952] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:15 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0c74-2071-482a-a2e9-03ea7182b9f0", "name": "network-vif-plugged", "status": "completed", "tag": "62239930-fb45-440e-8376-081e29157258"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Creating event network-vif-plugged:62239930-fb45-440e-8376-081e29157258 for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 on user Apr 11 21:02:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036750 Apr 11 21:02:15 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 316/953] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:16 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:02:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e78ca92a-fc28-4ae9-a19a-3cbd9f763a1e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 200 len: 1392 microversion: 2.1 time: 0.159890 Apr 11 21:02:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 321/954] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:02:16 2023] GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1609387619"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:16 user devstack@n-api.service[61909]: INFO nova.compute.api [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Attempting to quiesce instance before volume snapshot. Apr 11 21:02:16 user devstack@n-api.service[61909]: INFO nova.compute.api [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 21:02:16 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Creating snapshot from volume ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd. {{(pid=61909) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 21:02:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-b0260071-18d2-49af-a835-862715ec3b2f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2/action" status: 202 len: 0 microversion: 2.1 time: 2.540365 Apr 11 21:02:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 318/955] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:02:16 2023] POST /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2/action => generated 0 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1013735479", "imageRef": "4ed60277-ec4b-497b-9d16-7e1618210958", "flavorRef": "42", "networks": [{"uuid": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] validate_networks() for [('173a3c12-0c1e-4a4c-9682-6e5d62f61daa', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for user 3e34c9542bd64328a3c8d5cdb7421917 and project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:02:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='abd4d5f1-665f-4a18-9098-8d0e87fa312a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:02:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.542015 Apr 11 21:02:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 317/956] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:02:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:02:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c2af1796-aee0-46be-9d71-0074cc3b055f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c2af1796-aee0-46be-9d71-0074cc3b055f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:19 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-c2af1796-aee0-46be-9d71-0074cc3b055f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:02:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c2af1796-aee0-46be-9d71-0074cc3b055f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 200 len: 1224 microversion: 2.1 time: 0.071766 Apr 11 21:02:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 322/957] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:02:19 2023] GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 1224 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:02:22 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb1abe2-c389-4bae-a193-a4268557fbd2", "tag": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:22 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Creating event network-changed:ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 on user Apr 11 21:02:22 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105315 Apr 11 21:02:22 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 319/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=10 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb1abe2-c389-4bae-a193-a4268557fbd2", "name": "network-vif-plugged", "status": "completed", "tag": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Creating event network-vif-plugged:ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 on user Apr 11 21:02:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081239 Apr 11 21:02:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 318/959] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb1abe2-c389-4bae-a193-a4268557fbd2", "name": "network-vif-plugged", "status": "completed", "tag": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Creating event network-vif-plugged:ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 on user Apr 11 21:02:36 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043226 Apr 11 21:02:36 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 323/960] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1529368978", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "b786d8af-e6ba-41ff-8577-3472f89d17f0"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] validate_networks() for [('b786d8af-e6ba-41ff-8577-3472f89d17f0', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Getting quotas for project cf42a499ff3c43afaea1b716c0e801ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Getting quotas for user 8557484fdf27419384420c986b776a90 and project cf42a499ff3c43afaea1b716c0e801ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:02:41 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:02:41 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.622002 Apr 11 21:02:41 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 320/961] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:02:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:02:41 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-09e5582f-446f-465d-91a7-5c98a711185b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:41 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-09e5582f-446f-465d-91a7-5c98a711185b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:41 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-09e5582f-446f-465d-91a7-5c98a711185b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:02:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-09e5582f-446f-465d-91a7-5c98a711185b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 200 len: 1211 microversion: 2.1 time: 0.062876 Apr 11 21:02:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 319/962] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:02:41 2023] GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 1211 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:02:44 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4313738-e01e-49d3-880b-5c74b75b740a", "tag": "f6226fd1-15be-473c-93dd-3bcee5e8c530"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:44 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Creating event network-changed:f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance b4313738-e01e-49d3-880b-5c74b75b740a on user Apr 11 21:02:44 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038116 Apr 11 21:02:44 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 324/963] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:46 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4313738-e01e-49d3-880b-5c74b75b740a", "name": "network-vif-plugged", "status": "completed", "tag": "f6226fd1-15be-473c-93dd-3bcee5e8c530"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:46 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Creating event network-vif-plugged:f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance b4313738-e01e-49d3-880b-5c74b75b740a on user Apr 11 21:02:46 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100348 Apr 11 21:02:46 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 321/964] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:48 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4313738-e01e-49d3-880b-5c74b75b740a", "name": "network-vif-plugged", "status": "completed", "tag": "f6226fd1-15be-473c-93dd-3bcee5e8c530"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:48 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:48 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:48 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Creating event network-vif-plugged:f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance b4313738-e01e-49d3-880b-5c74b75b740a on user Apr 11 21:02:48 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050950 Apr 11 21:02:48 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 320/965] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:55 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:02:55 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667" status: 204 len: 0 microversion: 2.1 time: 0.129602 Apr 11 21:02:55 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 325/966] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:02:55 2023] DELETE /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:55 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f22d3582bd4d2da3b18d2d0b68c29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90afd2eb3cec40029264c2f35b2546a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:02:55 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-db2905a4-6bb8-440b-974e-5f980c7be176 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667" status: 200 len: 1460 microversion: 2.1 time: 0.176349 Apr 11 21:02:55 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 322/967] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:02:55 2023] GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667 => generated 1460 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:02:55 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:02:55 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de6fbc5-8846-4975-9ee4-3b554e1fd667", "name": "network-vif-unplugged", "status": "completed", "tag": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:55 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Creating event network-vif-unplugged:eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 on user Apr 11 21:02:55 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034210 Apr 11 21:02:55 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 321/968] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:56 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de6fbc5-8846-4975-9ee4-3b554e1fd667", "name": "network-vif-deleted", "tag": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:56 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:56 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] Creating event network-vif-deleted:eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 on user Apr 11 21:02:56 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030791 Apr 11 21:02:56 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 326/969] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:02:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de6fbc5-8846-4975-9ee4-3b554e1fd667", "name": "network-vif-plugged", "status": "completed", "tag": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:02:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:02:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:02:57 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:02:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Creating event network-vif-plugged:eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 on user Apr 11 21:02:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028582 Apr 11 21:02:57 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 323/970] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:02:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] HTTP exception thrown: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Request method failure captured: Apr 11 21:03:03 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0 HTTP/1.1 Apr 11 21:03:03 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:03:03 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:03:03 user devstack@n-api.service[61908]: Connection: close Apr 11 21:03:03 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:03:03 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:03:03 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:03:03 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:03:03 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcpg_AnHZfnZHMYHsPnLJITmiBfpdPqv_WF8AaO3Yj9EVf-KMNt7HHcrCi2D9k4tJGVkrAIK909psQfDxnDcc46YJ8jZKIuPZ5__41MjaqrtZUn5p0KhRVxlI10JyiyxWsGT9aSJ_Najz2IImQ0AOHHbyKSr58yaozpS9hxgVJKznFQ Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Project-Id: 9b0794c4a442430b8fc1faf0bd1ee1ca Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Project-Name: tempest-VolumesActionsTest-474021325 Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b0794c4a442430b8fc1faf0bd1ee1ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b0794c4a442430b8fc1faf0bd1ee1ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9b0794c4a442430b8fc1faf0bd1ee1ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Tenant: tempest-VolumesActionsTest-474021325 Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Tenant-Id: 9b0794c4a442430b8fc1faf0bd1ee1ca Apr 11 21:03:03 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-VolumesActionsTest-474021325 Apr 11 21:03:03 user devstack@n-api.service[61908]: X-User: tempest-VolumesActionsTest-474021325-project-member Apr 11 21:03:03 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:03:03 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:03:03 user devstack@n-api.service[61908]: X-User-Id: c721a6b00fdd479eaf8634f51e4a1b13 Apr 11 21:03:03 user devstack@n-api.service[61908]: X-User-Name: tempest-VolumesActionsTest-474021325-project-member Apr 11 21:03:03 user devstack@n-api.service[61908]: method: > Apr 11 21:03:03 user devstack@n-api.service[61908]: exception: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. Apr 11 21:03:03 user devstack@n-api.service[61908]: action_args: {'id': 'e13e0c74-2071-482a-a2e9-03ea7182b9f0'} Apr 11 21:03:03 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. Apr 11 21:03:03 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:03:03 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Returning 404 to user: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:03:03 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a7915a43-6b67-4bc9-a1d3-00b05aa84904 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0" status: 404 len: 111 microversion: 2.1 time: 0.032645 Apr 11 21:03:03 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 322/971] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:03:03 2023] GET /compute/v2.1/servers/e13e0c74-2071-482a-a2e9-03ea7182b9f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:03:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:10 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:03:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-05618718-cac2-4185-a51d-d7a6de6775a3 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 200 len: 1552 microversion: 2.1 time: 0.223674 Apr 11 21:03:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 327/972] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:03:09 2023] GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:03:25 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:25 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-788986832", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:03:25 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] validate_networks() for [('ae97f5a1-49e9-43e2-9e75-ef3e505e1027', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image limits 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image pref 0:0:0 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Getting quotas for project be7eb572d88b49979f0c987e7c14e078. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.quota [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Getting quotas for user 1a7549924a014f40a6568d7d771b6957 and project be7eb572d88b49979f0c987e7c14e078. Resources: {'cores', 'ram', 'instances'} {{(pid=61909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Going to run 1 instances... {{(pid=61909) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:03:26 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:03:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.468914 Apr 11 21:03:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 324/973] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:03:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:03:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-fca79cc3-251c-4011-b339-d90d516df7ce tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:03:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-fca79cc3-251c-4011-b339-d90d516df7ce tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:03:26 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:26 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:26 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-fca79cc3-251c-4011-b339-d90d516df7ce tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:03:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-fca79cc3-251c-4011-b339-d90d516df7ce tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689" status: 200 len: 1207 microversion: 2.1 time: 0.074099 Apr 11 21:03:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 323/974] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:03:26 2023] GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689 => generated 1207 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:03:28 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063e3089-9149-48d5-bf0c-6f4749ed2689", "tag": "1d8a8ce5-b487-4db2-9e49-093237df52ab"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:03:28 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:28 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:28 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Creating event network-changed:1d8a8ce5-b487-4db2-9e49-093237df52ab for instance 063e3089-9149-48d5-bf0c-6f4749ed2689 on user Apr 11 21:03:28 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033283 Apr 11 21:03:28 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 328/975] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:03:30 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e3089-9149-48d5-bf0c-6f4749ed2689", "name": "network-vif-plugged", "status": "completed", "tag": "1d8a8ce5-b487-4db2-9e49-093237df52ab"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:03:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:30 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Creating event network-vif-plugged:1d8a8ce5-b487-4db2-9e49-093237df52ab for instance 063e3089-9149-48d5-bf0c-6f4749ed2689 on user Apr 11 21:03:30 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037483 Apr 11 21:03:30 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 325/976] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:03:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:32 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:03:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1c60fdec-0fcb-4967-b80a-8810aa0a343f tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 200 len: 1495 microversion: 2.1 time: 0.143937 Apr 11 21:03:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:03:32 2023] GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 1495 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:03:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e3089-9149-48d5-bf0c-6f4749ed2689", "name": "network-vif-plugged", "status": "completed", "tag": "1d8a8ce5-b487-4db2-9e49-093237df52ab"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:03:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Creating event network-vif-plugged:1d8a8ce5-b487-4db2-9e49-093237df52ab for instance 063e3089-9149-48d5-bf0c-6f4749ed2689 on user Apr 11 21:03:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Apr 11 21:03:32 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 329/978] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:03:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:03:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] HTTP exception thrown: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Request method failure captured: Apr 11 21:03:45 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667 HTTP/1.1 Apr 11 21:03:45 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:03:45 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:03:45 user devstack@n-api.service[61909]: Connection: close Apr 11 21:03:45 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:03:45 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:03:45 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:03:45 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:03:45 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcqPz7In6Gr9GtgC1nAZKtwEu9mXFOYvp0u1ctcnnR3t52d3TSN67u_g-ekESUbtmqzOBf2WXiLbFBx2674r6dDIgDjEjpFHpzIcXaBdo788nhuLza_NW4fvYiGJKO4XILIqeGHRw4M5j3qJnKQ60Ca9iIjzcowXzrLvkCTQMlo3bTM Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Project-Id: 90afd2eb3cec40029264c2f35b2546a3 Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesNegativeTest-1031545147 Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90afd2eb3cec40029264c2f35b2546a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90afd2eb3cec40029264c2f35b2546a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90afd2eb3cec40029264c2f35b2546a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesNegativeTest-1031545147 Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Tenant-Id: 90afd2eb3cec40029264c2f35b2546a3 Apr 11 21:03:45 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesNegativeTest-1031545147 Apr 11 21:03:45 user devstack@n-api.service[61909]: X-User: tempest-VolumesNegativeTest-1031545147-project-member Apr 11 21:03:45 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:03:45 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:03:45 user devstack@n-api.service[61909]: X-User-Id: 57f22d3582bd4d2da3b18d2d0b68c29b Apr 11 21:03:45 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesNegativeTest-1031545147-project-member Apr 11 21:03:45 user devstack@n-api.service[61909]: method: > Apr 11 21:03:45 user devstack@n-api.service[61909]: exception: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. Apr 11 21:03:45 user devstack@n-api.service[61909]: action_args: {'id': '1de6fbc5-8846-4975-9ee4-3b554e1fd667'} Apr 11 21:03:45 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. Apr 11 21:03:45 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:03:45 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Returning 404 to user: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:03:45 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-4887d20a-d5e1-48df-86a7-4278b8062aac tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667" status: 404 len: 111 microversion: 2.1 time: 0.036949 Apr 11 21:03:45 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 326/979] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:03:45 2023] GET /compute/v2.1/servers/1de6fbc5-8846-4975-9ee4-3b554e1fd667 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:04:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-5808aeca-fe45-49fd-9ceb-4f320b821498 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 200 len: 1552 microversion: 2.1 time: 0.458246 Apr 11 21:04:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 325/980] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:04:10 2023] GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 1552 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:10 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:04:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 204 len: 0 microversion: 2.1 time: 0.123943 Apr 11 21:04:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 330/981] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:04:10 2023] DELETE /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:11 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:04:11 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-4cb28cd1-9561-4896-b661-2bce18094df7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 200 len: 1558 microversion: 2.1 time: 0.303623 Apr 11 21:04:11 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 327/982] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:04:10 2023] GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 1558 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:04:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb1abe2-c389-4bae-a193-a4268557fbd2", "name": "network-vif-unplugged", "status": "completed", "tag": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:12 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Creating event network-vif-unplugged:ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 on user Apr 11 21:04:12 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029233 Apr 11 21:04:12 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 326/983] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:14 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb1abe2-c389-4bae-a193-a4268557fbd2", "name": "network-vif-plugged", "status": "completed", "tag": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4"}, {"server_uuid": "3bb1abe2-c389-4bae-a193-a4268557fbd2", "name": "network-vif-deleted", "tag": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:14 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Creating event network-vif-plugged:ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 on user Apr 11 21:04:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Creating event network-vif-deleted:ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 on user Apr 11 21:04:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032094 Apr 11 21:04:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 331/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:16 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:04:16 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-9613bd7d-8e8c-4210-9c50-0f91dd2eefc7 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689" status: 200 len: 1484 microversion: 2.1 time: 0.182179 Apr 11 21:04:16 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 328/985] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:04:16 2023] GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689 => generated 1484 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:04:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-827145e5-99ed-4e8d-87af-66dc777f9972 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Action: 'create', calling method: .version_select at 0x7f726879e4d0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1721986425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXcw4d2/8Jyu4uN3Xyg+X/eTr/DWWnycZDnu/3iBhuvtkr6XoB58mgAQA2Bk3kZzz9pP6hq8KlOXoNwcGwWwN+8S8qZEYZRoUCYs8XACvyH5uN5IV1XGuLn09Beb+3ruQ=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:18 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-827145e5-99ed-4e8d-87af-66dc777f9972 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting quotas for project 6233baae51b44238a630a75ccea0bdbf. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:04:18 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-827145e5-99ed-4e8d-87af-66dc777f9972 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting quotas for user 03d8e96524894243b3226f4df3c42376 and project 6233baae51b44238a630a75ccea0bdbf. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:04:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-827145e5-99ed-4e8d-87af-66dc777f9972 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.252093 Apr 11 21:04:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 327/986] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:04:17 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1796483703", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1721986425", "security_groups": [{"name": "tempest-secgroup-smoke-241668796"}], "networks": [{"uuid": "ec3fa1b2-939c-4388-af73-96cb46915f76"}]}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] validate_networks() for [('ec3fa1b2-939c-4388-af73-96cb46915f76', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting quotas for project 6233baae51b44238a630a75ccea0bdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting quotas for user 03d8e96524894243b3226f4df3c42376 and project 6233baae51b44238a630a75ccea0bdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:04:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:04:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.538155 Apr 11 21:04:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 332/987] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:04:19 2023] POST /compute/v2.1/servers => generated 403 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:04:19 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8f9d2e17-b7e2-4f6b-b46c-855195c92a6a tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:19 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8f9d2e17-b7e2-4f6b-b46c-855195c92a6a tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:19 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-8f9d2e17-b7e2-4f6b-b46c-855195c92a6a tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d8e96524894243b3226f4df3c42376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6233baae51b44238a630a75ccea0bdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:04:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8f9d2e17-b7e2-4f6b-b46c-855195c92a6a tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb" status: 200 len: 1257 microversion: 2.1 time: 0.061484 Apr 11 21:04:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 329/988] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:04:19 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb => generated 1257 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:04:22 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:22 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Creating event network-changed:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:04:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031083 Apr 11 21:04:22 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 328/989] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "name": "network-vif-plugged", "status": "completed", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Creating event network-vif-plugged:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:04:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029275 Apr 11 21:04:24 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 333/990] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "name": "network-vif-plugged", "status": "completed", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:26 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=12 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:26 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Creating event network-vif-plugged:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:04:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039207 Apr 11 21:04:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 330/991] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:32 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:04:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 204 len: 0 microversion: 2.1 time: 0.131395 Apr 11 21:04:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 329/992] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:04:32 2023] DELETE /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:32 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:04:32 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-cc76a20f-3c06-4aa7-b626-c55d66fdb2dc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 200 len: 1501 microversion: 2.1 time: 0.184828 Apr 11 21:04:32 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 334/993] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:04:32 2023] GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:04:32 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:04:32 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4313738-e01e-49d3-880b-5c74b75b740a", "name": "network-vif-unplugged", "status": "completed", "tag": "f6226fd1-15be-473c-93dd-3bcee5e8c530"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:32 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Creating event network-vif-unplugged:f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance b4313738-e01e-49d3-880b-5c74b75b740a on user Apr 11 21:04:32 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042219 Apr 11 21:04:32 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 331/994] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:33 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4313738-e01e-49d3-880b-5c74b75b740a", "name": "network-vif-deleted", "tag": "f6226fd1-15be-473c-93dd-3bcee5e8c530"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:33 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] Creating event network-vif-deleted:f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance b4313738-e01e-49d3-880b-5c74b75b740a on user Apr 11 21:04:33 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040361 Apr 11 21:04:33 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 330/995] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:04:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4313738-e01e-49d3-880b-5c74b75b740a", "name": "network-vif-plugged", "status": "completed", "tag": "f6226fd1-15be-473c-93dd-3bcee5e8c530"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:04:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:04:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:04:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:04:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Creating event network-vif-plugged:f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance b4313738-e01e-49d3-880b-5c74b75b740a on user Apr 11 21:04:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027811 Apr 11 21:04:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 335/996] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=14 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:05:01 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 HTTP/1.1 Apr 11 21:05:01 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:05:01 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:05:01 user devstack@n-api.service[61909]: Connection: close Apr 11 21:05:01 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:05:01 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:05:01 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:05:01 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:05:01 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:01 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:05:01 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:05:01 user devstack@n-api.service[61909]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:05:01 user devstack@n-api.service[61909]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:01 user devstack@n-api.service[61909]: method: > Apr 11 21:05:01 user devstack@n-api.service[61909]: exception: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:01 user devstack@n-api.service[61909]: action_args: {'id': '3bb1abe2-c389-4bae-a193-a4268557fbd2'} Apr 11 21:05:01 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:01 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:01 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:01 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-65b49558-4e4f-4878-9c27-b8cf74c05f5d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 404 len: 111 microversion: 2.1 time: 0.041330 Apr 11 21:05:01 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 332/997] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:01 2023] GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:02 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:05:02 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 204 len: 0 microversion: 2.1 time: 0.112990 Apr 11 21:05:02 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 331/998] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:05:02 2023] DELETE /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:02 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:05:02 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8fa8fb6c-5ce5-4c63-90c5-b4eb0ce8950d tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 200 len: 1398 microversion: 2.1 time: 0.192997 Apr 11 21:05:02 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 336/999] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:02 2023] GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 1398 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:05:02 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb5a48-11e6-4d15-a10e-41a3067944a2", "name": "network-vif-unplugged", "status": "completed", "tag": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:02 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Creating event network-vif-unplugged:4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 on user Apr 11 21:05:02 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029568 Apr 11 21:05:02 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 333/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:05:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:04 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb5a48-11e6-4d15-a10e-41a3067944a2", "name": "network-vif-deleted", "tag": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:04 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] Creating event network-vif-deleted:4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 on user Apr 11 21:05:04 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032325 Apr 11 21:05:04 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 332/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:05:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:04 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb5a48-11e6-4d15-a10e-41a3067944a2", "name": "network-vif-plugged", "status": "completed", "tag": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:04 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Creating event network-vif-plugged:4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 on user Apr 11 21:05:04 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030569 Apr 11 21:05:04 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 337/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:05:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:10 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d8e96524894243b3226f4df3c42376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6233baae51b44238a630a75ccea0bdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:05:10 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-c82c92b1-0a3d-43b3-8a72-3dc459a80edc tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb" status: 200 len: 1569 microversion: 2.1 time: 0.164138 Apr 11 21:05:10 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 334/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:10 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:17 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:05:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689" status: 204 len: 0 microversion: 2.1 time: 0.140856 Apr 11 21:05:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 333/1004] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:05:17 2023] DELETE /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:17 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:05:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-34baeda8-dbf5-4966-b39e-8bea063cfd5c tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689" status: 200 len: 1490 microversion: 2.1 time: 0.229929 Apr 11 21:05:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 338/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:17 2023] GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689 => generated 1490 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:05:17 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e3089-9149-48d5-bf0c-6f4749ed2689", "name": "network-vif-unplugged", "status": "completed", "tag": "1d8a8ce5-b487-4db2-9e49-093237df52ab"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:17 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Creating event network-vif-unplugged:1d8a8ce5-b487-4db2-9e49-093237df52ab for instance 063e3089-9149-48d5-bf0c-6f4749ed2689 on user Apr 11 21:05:17 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030321 Apr 11 21:05:17 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 335/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e3089-9149-48d5-bf0c-6f4749ed2689", "name": "network-vif-deleted", "tag": "1d8a8ce5-b487-4db2-9e49-093237df52ab"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] Creating event network-vif-deleted:1d8a8ce5-b487-4db2-9e49-093237df52ab for instance 063e3089-9149-48d5-bf0c-6f4749ed2689 on user Apr 11 21:05:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031138 Apr 11 21:05:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 334/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e3089-9149-48d5-bf0c-6f4749ed2689", "name": "network-vif-plugged", "status": "completed", "tag": "1d8a8ce5-b487-4db2-9e49-093237df52ab"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Creating event network-vif-plugged:1d8a8ce5-b487-4db2-9e49-093237df52ab for instance 063e3089-9149-48d5-bf0c-6f4749ed2689 on user Apr 11 21:05:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 Apr 11 21:05:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 339/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:05:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:22 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] HTTP exception thrown: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Request method failure captured: Apr 11 21:05:22 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a HTTP/1.1 Apr 11 21:05:22 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:05:22 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:05:22 user devstack@n-api.service[61909]: Connection: close Apr 11 21:05:22 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:05:22 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:05:22 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:05:22 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:05:22 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcqBFg2FhH1Dwvp08OlK-znDZSWdAuF6iIVekdbCHWeqwAG3Nu3flXrlxGNhN6Y05Wqm2a5sTcwPJePhhLqINkcyhq8rqGohqer-_z8wTurTG5Q_IIhOmPiywLKpkStD0E_2uVpLIQx9wt8b4PDbTezzu9IsSB018qZGnBZEdpW6EdA Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Project-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Tenant: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Tenant-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:05:22 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:05:22 user devstack@n-api.service[61909]: X-User: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:05:22 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:05:22 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:05:22 user devstack@n-api.service[61909]: X-User-Id: 8557484fdf27419384420c986b776a90 Apr 11 21:05:22 user devstack@n-api.service[61909]: X-User-Name: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:05:22 user devstack@n-api.service[61909]: method: > Apr 11 21:05:22 user devstack@n-api.service[61909]: exception: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:05:22 user devstack@n-api.service[61909]: action_args: {'id': 'b4313738-e01e-49d3-880b-5c74b75b740a'} Apr 11 21:05:22 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:05:22 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:22 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Returning 404 to user: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:22 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-8d90525c-00ca-47b6-a0e6-69d96083f0fe tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 404 len: 111 microversion: 2.1 time: 0.032115 Apr 11 21:05:22 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 336/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:22 2023] GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:22 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:05:22 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c0593c9f-e7c9-427a-a0e6-ab3c4a2ddc4c tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1494 microversion: 2.1 time: 0.151387 Apr 11 21:05:22 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 335/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:22 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1494 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:05:52 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 HTTP/1.1 Apr 11 21:05:52 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:05:52 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:05:52 user devstack@n-api.service[61907]: Connection: close Apr 11 21:05:52 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:05:52 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:05:52 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:05:52 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:05:52 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:52 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:05:52 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:05:52 user devstack@n-api.service[61907]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:05:52 user devstack@n-api.service[61907]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:52 user devstack@n-api.service[61907]: method: > Apr 11 21:05:52 user devstack@n-api.service[61907]: exception: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61907]: action_args: {'id': 'd6eb5a48-11e6-4d15-a10e-41a3067944a2'} Apr 11 21:05:52 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-51a00949-8067-4005-b8e0-6d87aed8d3b7 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 404 len: 111 microversion: 2.1 time: 0.033128 Apr 11 21:05:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 340/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:52 2023] GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=10 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=14 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:05:52 user devstack@n-api.service[61909]: request: DELETE /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 HTTP/1.1 Apr 11 21:05:52 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:05:52 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:05:52 user devstack@n-api.service[61909]: Connection: close Apr 11 21:05:52 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:05:52 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:05:52 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:05:52 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:05:52 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:52 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:05:52 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:05:52 user devstack@n-api.service[61909]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:05:52 user devstack@n-api.service[61909]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:52 user devstack@n-api.service[61909]: method: > Apr 11 21:05:52 user devstack@n-api.service[61909]: exception: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61909]: action_args: {'id': '3bb1abe2-c389-4bae-a193-a4268557fbd2'} Apr 11 21:05:52 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:52 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-2b2967a5-8d03-4658-a1df-255a93faab43 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 404 len: 111 microversion: 2.1 time: 0.032442 Apr 11 21:05:52 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 337/1012] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:05:52 2023] DELETE /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:05:52 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 HTTP/1.1 Apr 11 21:05:52 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:05:52 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:05:52 user devstack@n-api.service[61908]: Connection: close Apr 11 21:05:52 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:05:52 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:05:52 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:05:52 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:05:52 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:52 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:05:52 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:05:52 user devstack@n-api.service[61908]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:05:52 user devstack@n-api.service[61908]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:52 user devstack@n-api.service[61908]: method: > Apr 11 21:05:52 user devstack@n-api.service[61908]: exception: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61908]: action_args: {'id': '3bb1abe2-c389-4bae-a193-a4268557fbd2'} Apr 11 21:05:52 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. Apr 11 21:05:52 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:05:52 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:52 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-c37c7eb8-5d5a-4b18-9a7e-a83631377a63 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2" status: 404 len: 111 microversion: 2.1 time: 0.037705 Apr 11 21:05:52 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 336/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:52 2023] GET /compute/v2.1/servers/3bb1abe2-c389-4bae-a193-a4268557fbd2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:05:53 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 HTTP/1.1 Apr 11 21:05:53 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:05:53 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:05:53 user devstack@n-api.service[61907]: Connection: close Apr 11 21:05:53 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:05:53 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:05:53 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:05:53 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:05:53 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:53 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:05:53 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:05:53 user devstack@n-api.service[61907]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:05:53 user devstack@n-api.service[61907]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:53 user devstack@n-api.service[61907]: method: > Apr 11 21:05:53 user devstack@n-api.service[61907]: exception: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61907]: action_args: {'id': 'd6eb5a48-11e6-4d15-a10e-41a3067944a2'} Apr 11 21:05:53 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:53 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b84a7d1e-ace2-4a61-bead-8652afc59868 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 404 len: 111 microversion: 2.1 time: 0.030078 Apr 11 21:05:53 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 341/1014] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:05:53 2023] DELETE /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:05:53 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 HTTP/1.1 Apr 11 21:05:53 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:05:53 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:05:53 user devstack@n-api.service[61909]: Connection: close Apr 11 21:05:53 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:05:53 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:05:53 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:05:53 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:05:53 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:53 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:05:53 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:05:53 user devstack@n-api.service[61909]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:05:53 user devstack@n-api.service[61909]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:05:53 user devstack@n-api.service[61909]: method: > Apr 11 21:05:53 user devstack@n-api.service[61909]: exception: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61909]: action_args: {'id': 'd6eb5a48-11e6-4d15-a10e-41a3067944a2'} Apr 11 21:05:53 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. Apr 11 21:05:53 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:05:53 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:05:53 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-ac2a4cdb-a4ee-4e50-bbc0-1254925451dc tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2" status: 404 len: 111 microversion: 2.1 time: 0.027516 Apr 11 21:05:53 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 338/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:53 2023] GET /compute/v2.1/servers/d6eb5a48-11e6-4d15-a10e-41a3067944a2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:05:53 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-dd8a99c0-817c-4a83-80a0-14ce7fb28e83 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'create', calling method: .version_select at 0x7f7268846830>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1519294118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDrqhkrym1CfZlb+r+GlNopr6aTwGNF6ss7D41NMi4Nte1p/A4pHRSGMcx1DkMqprm9O4VBj6JyfebwxXg2lgckuEdr334CnYf3AxzSbFaUNZmKliEG84dDSfywNcdtnQ=="}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:53 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-dd8a99c0-817c-4a83-80a0-14ce7fb28e83 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:05:53 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-dd8a99c0-817c-4a83-80a0-14ce7fb28e83 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for user 3e34c9542bd64328a3c8d5cdb7421917 and project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'key_pairs'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:05:53 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-dd8a99c0-817c-4a83-80a0-14ce7fb28e83 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.045006 Apr 11 21:05:53 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 337/1016] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:05:53 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:05:56 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1308181043", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1519294118", "security_groups": [{"name": "tempest-secgroup-smoke-2042118004"}], "block_device_mapping_v2": [{"uuid": "86fa1780-adb9-4e29-b424-0e7bfeee531d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa"}]}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:05:56 user devstack@n-api.service[61907]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] validate_networks() for [('173a3c12-0c1e-4a4c-9682-6e5d62f61daa', None, None, None, None, None)] {{(pid=61907) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting quotas for user 3e34c9542bd64328a3c8d5cdb7421917 and project 2c36c3a15f2a413e81544f65c4f6ede4. Resources: {'cores', 'ram', 'instances'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Going to run 1 instances... {{(pid=61907) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:05:57 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86fa1780-adb9-4e29-b424-0e7bfeee531d',volume_size=None,volume_type=None)] {{(pid=61907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:05:57 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.880162 Apr 11 21:05:57 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 342/1017] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:05:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:05:57 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-09436f80-bd35-46ac-b8f4-6edc9bf8fff8 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:05:57 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-09436f80-bd35-46ac-b8f4-6edc9bf8fff8 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:05:57 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-09436f80-bd35-46ac-b8f4-6edc9bf8fff8 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:05:57 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-09436f80-bd35-46ac-b8f4-6edc9bf8fff8 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 200 len: 1090 microversion: 2.1 time: 0.098244 Apr 11 21:05:57 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 339/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:05:57 2023] GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 1090 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:06:00 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:00 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Creating event network-changed:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:06:00 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031311 Apr 11 21:06:00 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 338/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:06 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "name": "network-vif-plugged", "status": "completed", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:06 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:06 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:06 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Creating event network-vif-plugged:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:06:06 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035482 Apr 11 21:06:06 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 343/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell0:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.wsgi [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] HTTP exception thrown: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Request method failure captured: Apr 11 21:06:07 user devstack@n-api.service[61909]: request: GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689 HTTP/1.1 Apr 11 21:06:07 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:06:07 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:06:07 user devstack@n-api.service[61909]: Connection: close Apr 11 21:06:07 user devstack@n-api.service[61909]: Content-Length: 0 Apr 11 21:06:07 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:06:07 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:06:07 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:06:07 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcscd-l_YaMR5E3JA18RBQcN6o2VnQ89A-2NPrO1HXdJWtvO6PS4E-JXVwLJJTyOF70xm8O6E2r_AB71RKsumm1HgtipmehrRmob9QpLMKuB_5r8Kl6yHFfRBYLq_R447nNWaPPOalEAPqtlVYCt04Y2EzuILOpTliM4MXfQf9dyHFA Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Project-Id: be7eb572d88b49979f0c987e7c14e078 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Project-Name: tempest-VolumesActionsTest-938970583 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be7eb572d88b49979f0c987e7c14e078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be7eb572d88b49979f0c987e7c14e078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be7eb572d88b49979f0c987e7c14e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Tenant: tempest-VolumesActionsTest-938970583 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Tenant-Id: be7eb572d88b49979f0c987e7c14e078 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-VolumesActionsTest-938970583 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-User: tempest-VolumesActionsTest-938970583-project-member Apr 11 21:06:07 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:06:07 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:06:07 user devstack@n-api.service[61909]: X-User-Id: 1a7549924a014f40a6568d7d771b6957 Apr 11 21:06:07 user devstack@n-api.service[61909]: X-User-Name: tempest-VolumesActionsTest-938970583-project-member Apr 11 21:06:07 user devstack@n-api.service[61909]: method: > Apr 11 21:06:07 user devstack@n-api.service[61909]: exception: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. Apr 11 21:06:07 user devstack@n-api.service[61909]: action_args: {'id': '063e3089-9149-48d5-bf0c-6f4749ed2689'} Apr 11 21:06:07 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. Apr 11 21:06:07 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:06:07 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Returning 404 to user: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:06:07 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-664d88e7-9018-41e7-a05b-1bda7515f5a9 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689" status: 404 len: 111 microversion: 2.1 time: 0.050554 Apr 11 21:06:07 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 340/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:06:07 2023] GET /compute/v2.1/servers/063e3089-9149-48d5-bf0c-6f4749ed2689 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:06:07 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-966792145", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "networks": [{"uuid": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:07 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:07 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] validate_networks() for [('ae97f5a1-49e9-43e2-9e75-ef3e505e1027', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Getting quotas for project be7eb572d88b49979f0c987e7c14e078. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Getting quotas for user 1a7549924a014f40a6568d7d771b6957 and project be7eb572d88b49979f0c987e7c14e078. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:06:08 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:06:08 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.523335 Apr 11 21:06:08 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 339/1022] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:06:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:06:08 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:08 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:08 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9d9c3973-05d0-4006-bdd1-2105519479ea tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:08 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9d9c3973-05d0-4006-bdd1-2105519479ea tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:08 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-9d9c3973-05d0-4006-bdd1-2105519479ea tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:06:08 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9d9c3973-05d0-4006-bdd1-2105519479ea tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257" status: 200 len: 1207 microversion: 2.1 time: 0.069040 Apr 11 21:06:08 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 344/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:06:08 2023] GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257 => generated 1207 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:06:08 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "name": "network-vif-plugged", "status": "completed", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:08 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:08 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Creating event network-vif-plugged:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:06:08 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043571 Apr 11 21:06:08 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 341/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:10 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d8e96524894243b3226f4df3c42376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6233baae51b44238a630a75ccea0bdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:06:10 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-59558763-323c-45a0-99d2-8f2a4e6c577b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb" status: 200 len: 1569 microversion: 2.1 time: 0.141730 Apr 11 21:06:10 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 340/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:06:10 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:06:10 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a7a0115-1cce-4dab-8207-812e4836a257", "tag": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:10 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Creating event network-changed:1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance 0a7a0115-1cce-4dab-8207-812e4836a257 on user Apr 11 21:06:10 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028663 Apr 11 21:06:10 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 345/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:12 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7a0115-1cce-4dab-8207-812e4836a257", "name": "network-vif-plugged", "status": "completed", "tag": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:12 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Creating event network-vif-plugged:1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance 0a7a0115-1cce-4dab-8207-812e4836a257 on user Apr 11 21:06:12 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035413 Apr 11 21:06:12 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 342/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:13 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:13 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:13 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Creating event network-changed:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:06:13 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030446 Apr 11 21:06:13 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 341/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ff5fef0-1950-4555-b748-8508d8567ef8"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:13 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:14 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298289 Apr 11 21:06:14 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 346/1029] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:06:13 2023] POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:14 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7a0115-1cce-4dab-8207-812e4836a257", "name": "network-vif-plugged", "status": "completed", "tag": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:14 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Creating event network-vif-plugged:1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance 0a7a0115-1cce-4dab-8207-812e4836a257 on user Apr 11 21:06:14 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 Apr 11 21:06:14 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 343/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=14 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3126d889-a33b-45ff-a059-814b3eaa3e08 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-953916229", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0fd51bba-b98b-4253-9a3f-a75683dba756", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b786d8af-e6ba-41ff-8577-3472f89d17f0"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:06:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-3126d889-a33b-45ff-a059-814b3eaa3e08 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] HTTP exception thrown: Block Device 0fd51bba-b98b-4253-9a3f-a75683dba756 is not bootable. Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3126d889-a33b-45ff-a059-814b3eaa3e08 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Request method failure captured: Apr 11 21:06:24 user devstack@n-api.service[61908]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 21:06:24 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:06:24 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:06:24 user devstack@n-api.service[61908]: Connection: close Apr 11 21:06:24 user devstack@n-api.service[61908]: Content-Length: 356 Apr 11 21:06:24 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:06:24 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:06:24 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:06:24 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcqBFg2FhH1Dwvp08OlK-znDZSWdAuF6iIVekdbCHWeqwAG3Nu3flXrlxGNhN6Y05Wqm2a5sTcwPJePhhLqINkcyhq8rqGohqer-_z8wTurTG5Q_IIhOmPiywLKpkStD0E_2uVpLIQx9wt8b4PDbTezzu9IsSB018qZGnBZEdpW6EdA Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Project-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Tenant: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Tenant-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:06:24 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:06:24 user devstack@n-api.service[61908]: X-User: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:06:24 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:06:24 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:06:24 user devstack@n-api.service[61908]: X-User-Id: 8557484fdf27419384420c986b776a90 Apr 11 21:06:24 user devstack@n-api.service[61908]: X-User-Name: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:06:24 user devstack@n-api.service[61908]: Apr 11 21:06:24 user devstack@n-api.service[61908]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-953916229", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0fd51bba-b98b-4253-9a3f-a75683dba756", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b786d8af-e6ba-41ff-8577-3472f89d17f0"}]}} Apr 11 21:06:24 user devstack@n-api.service[61908]: method: > Apr 11 21:06:24 user devstack@n-api.service[61908]: exception: Block Device 0fd51bba-b98b-4253-9a3f-a75683dba756 is not bootable. Apr 11 21:06:24 user devstack@n-api.service[61908]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-953916229', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0fd51bba-b98b-4253-9a3f-a75683dba756'}], 'networks': [{'uuid': 'b786d8af-e6ba-41ff-8577-3472f89d17f0'}]}}} Apr 11 21:06:24 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0fd51bba-b98b-4253-9a3f-a75683dba756 is not bootable. Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0fd51bba-b98b-4253-9a3f-a75683dba756 is not bootable. Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0fd51bba-b98b-4253-9a3f-a75683dba756 is not bootable. Apr 11 21:06:24 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:06:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-3126d889-a33b-45ff-a059-814b3eaa3e08 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Returning 400 to user: Block Device 0fd51bba-b98b-4253-9a3f-a75683dba756 is not bootable. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:06:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-3126d889-a33b-45ff-a059-814b3eaa3e08 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.108625 Apr 11 21:06:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 342/1031] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:06:24 2023] POST /compute/v2.1/servers => generated 110 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:24 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:06:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-5fce1e9b-8062-4264-be0d-45688e6985cc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1494 microversion: 2.1 time: 0.192302 Apr 11 21:06:24 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 347/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:06:24 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1494 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=8 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:27 user devstack@n-api.service[61909]: DEBUG nova.objects.instance [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'services' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=61909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:06:27 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/8ff5fef0-1950-4555-b748-8508d8567ef8" status: 202 len: 0 microversion: 2.1 time: 0.238559 Apr 11 21:06:27 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 344/1033] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:06:27 2023] DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/8ff5fef0-1950-4555-b748-8508d8567ef8 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1a1c6ad7-1820-420f-9abc-f9a8d54e428e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049390 Apr 11 21:06:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 343/1034] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:06:27 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:47 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:06:47 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-7c42f4c6-ff6e-4f55-bdd8-c8f8c2642dfd tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 200 len: 1444 microversion: 2.1 time: 0.162166 Apr 11 21:06:47 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 348/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:06:47 2023] GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:06:58 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:06:58 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-2f363806-b526-4307-9088-bc442af28dff tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257" status: 200 len: 1484 microversion: 2.1 time: 0.183913 Apr 11 21:06:58 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 345/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:06:58 2023] GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257 => generated 1484 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:17 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-40b3a61f-137c-4bb2-be2f-658f631004cd tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048737 Apr 11 21:07:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 344/1037] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:07:17 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31b81ba1-36ae-4686-814c-aca8bc2354d3"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:19 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281533 Apr 11 21:07:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 349/1038] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:07:19 2023] POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:25 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:07:25 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-4eedfbf5-5d1a-4829-be30-ea5b58b797bd tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1494 microversion: 2.1 time: 0.213657 Apr 11 21:07:25 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 346/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:07:25 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1494 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:26 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'services' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:07:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/31b81ba1-36ae-4686-814c-aca8bc2354d3" status: 202 len: 0 microversion: 2.1 time: 0.246388 Apr 11 21:07:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 345/1040] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:07:26 2023] DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/31b81ba1-36ae-4686-814c-aca8bc2354d3 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9fe90458-18eb-4251-b864-1bc2647246b6 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049225 Apr 11 21:07:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 350/1041] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:07:26 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=6 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:47 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:07:47 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-c3b286bb-b703-435e-a943-d6b738735d9e tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 200 len: 1444 microversion: 2.1 time: 0.157880 Apr 11 21:07:47 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 347/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:07:47 2023] GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Creating event network-changed:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:07:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109198 Apr 11 21:07:50 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 346/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:50 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:07:50 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 204 len: 0 microversion: 2.1 time: 0.117152 Apr 11 21:07:50 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 351/1044] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:07:50 2023] DELETE /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:50 user devstack@n-api.service[61909]: DEBUG nova.policy [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61909) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:07:50 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-39038210-c9df-44e0-b302-02f90961f639 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 200 len: 1450 microversion: 2.1 time: 0.226546 Apr 11 21:07:50 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 348/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:07:50 2023] GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 1450 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "name": "network-vif-unplugged", "status": "completed", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:50 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Creating event network-vif-unplugged:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:07:50 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080780 Apr 11 21:07:50 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 347/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:07:52 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "name": "network-vif-plugged", "status": "completed", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}, {"server_uuid": "ac91ed34-8f95-477d-a951-efa13ccff67b", "name": "network-vif-deleted", "tag": "4b20f01b-63c6-48df-ad3e-656d1ba8178d"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:07:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:52 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Creating event network-vif-plugged:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:07:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Creating event network-vif-deleted:4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance ac91ed34-8f95-477d-a951-efa13ccff67b on user Apr 11 21:07:52 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033522 Apr 11 21:07:52 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 352/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:07:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:59 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Going to try to terminate instance {{(pid=61909) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:07:59 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257" status: 204 len: 0 microversion: 2.1 time: 0.114136 Apr 11 21:07:59 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 349/1048] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:07:59 2023] DELETE /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:59 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:07:59 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6330abfb-c6f2-4d57-a3b0-d272d6ee7ae5 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257" status: 200 len: 1490 microversion: 2.1 time: 0.230073 Apr 11 21:07:59 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 348/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:07:59 2023] GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257 => generated 1490 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:07:59 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7a0115-1cce-4dab-8207-812e4836a257", "name": "network-vif-unplugged", "status": "completed", "tag": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:07:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:07:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:07:59 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:07:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Creating event network-vif-unplugged:1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance 0a7a0115-1cce-4dab-8207-812e4836a257 on user Apr 11 21:07:59 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084416 Apr 11 21:07:59 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 353/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:07:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:08:00 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7a0115-1cce-4dab-8207-812e4836a257", "name": "network-vif-deleted", "tag": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578"}]} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:08:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:00 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.compute.server_external_events [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] Creating event network-vif-deleted:1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance 0a7a0115-1cce-4dab-8207-812e4836a257 on user Apr 11 21:08:00 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042979 Apr 11 21:08:00 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 350/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:08:01 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7a0115-1cce-4dab-8207-812e4836a257", "name": "network-vif-plugged", "status": "completed", "tag": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:08:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:01 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Creating event network-vif-plugged:1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance 0a7a0115-1cce-4dab-8207-812e4836a257 on user Apr 11 21:08:01 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Apr 11 21:08:01 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 349/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:08:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:17 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:17 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-7af7f301-cd6f-4898-aea0-0b49df2e7f26 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052154 Apr 11 21:08:17 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 354/1053] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:08:17 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf6943db-ba5e-49c3-a37d-4fc41648581a"}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG nova.compute.api [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61909) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:18 user devstack@n-api.service[61909]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61909) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:19 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425918 Apr 11 21:08:19 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 351/1054] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:08:18 2023] POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'services' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:08:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/cf6943db-ba5e-49c3-a37d-4fc41648581a" status: 202 len: 0 microversion: 2.1 time: 0.174639 Apr 11 21:08:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 350/1055] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:08:26 2023] DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/cf6943db-ba5e-49c3-a37d-4fc41648581a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d02cd719-1d29-46be-9e84-c7bca68ff136 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Apr 11 21:08:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 355/1056] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:08:26 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:08:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-de42455e-394f-4e87-96b5-499017412a2b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2136201217", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "destination_type": "local"}, {"source_type": "volume", "uuid": "a6cc33ab-6b26-452e-be02-dde48872e09c", "destination_type": "invalid"}], "networks": [{"uuid": "b786d8af-e6ba-41ff-8577-3472f89d17f0"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:08:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-de42455e-394f-4e87-96b5-499017412a2b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Request method failure captured: Apr 11 21:08:26 user devstack@n-api.service[61909]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 21:08:26 user devstack@n-api.service[61909]: Accept: application/json Apr 11 21:08:26 user devstack@n-api.service[61909]: Accept-Encoding: identity Apr 11 21:08:26 user devstack@n-api.service[61909]: Connection: close Apr 11 21:08:26 user devstack@n-api.service[61909]: Content-Length: 494 Apr 11 21:08:26 user devstack@n-api.service[61909]: Content-Type: application/json Apr 11 21:08:26 user devstack@n-api.service[61909]: Host: 10.0.0.210 Apr 11 21:08:26 user devstack@n-api.service[61909]: Openstack-System-Scope: None Apr 11 21:08:26 user devstack@n-api.service[61909]: User-Agent: python-urllib3/1.26.15 Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Auth-Token: gAAAAABkNcqBFg2FhH1Dwvp08OlK-znDZSWdAuF6iIVekdbCHWeqwAG3Nu3flXrlxGNhN6Y05Wqm2a5sTcwPJePhhLqINkcyhq8rqGohqer-_z8wTurTG5Q_IIhOmPiywLKpkStD0E_2uVpLIQx9wt8b4PDbTezzu9IsSB018qZGnBZEdpW6EdA Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Domain-Id: None Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Domain-Name: None Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Identity-Status: Confirmed Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Is-Admin-Project: True Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Project-Domain-Id: default Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Project-Domain-Name: Default Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Project-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Project-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Role: member,reader Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Roles: member,reader Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Tenant: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Tenant-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:08:26 user devstack@n-api.service[61909]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:08:26 user devstack@n-api.service[61909]: X-User: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:08:26 user devstack@n-api.service[61909]: X-User-Domain-Id: default Apr 11 21:08:26 user devstack@n-api.service[61909]: X-User-Domain-Name: Default Apr 11 21:08:26 user devstack@n-api.service[61909]: X-User-Id: 8557484fdf27419384420c986b776a90 Apr 11 21:08:26 user devstack@n-api.service[61909]: X-User-Name: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:08:26 user devstack@n-api.service[61909]: Apr 11 21:08:26 user devstack@n-api.service[61909]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2136201217", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "destination_type": "local"}, {"source_type": "volume", "uuid": "a6cc33ab-6b26-452e-be02-dde48872e09c", "destination_type": "invalid"}], "networks": [{"uuid": "b786d8af-e6ba-41ff-8577-3472f89d17f0"}]}} Apr 11 21:08:26 user devstack@n-api.service[61909]: method: > Apr 11 21:08:26 user devstack@n-api.service[61909]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 21:08:26 user devstack@n-api.service[61909]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2136201217', 'imageRef': '5eb5099b-ba97-47ac-833b-8ebacdc3051a', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5eb5099b-ba97-47ac-833b-8ebacdc3051a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a6cc33ab-6b26-452e-be02-dde48872e09c', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b786d8af-e6ba-41ff-8577-3472f89d17f0'}]}}} Apr 11 21:08:26 user devstack@n-api.service[61909]: {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise error Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 21:08:26 user devstack@n-api.service[61909]: ERROR nova.api.openstack.wsgi Apr 11 21:08:26 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-de42455e-394f-4e87-96b5-499017412a2b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:08:26 user devstack@n-api.service[61909]: INFO nova.api.openstack.requestlog [None req-de42455e-394f-4e87-96b5-499017412a2b tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013204 Apr 11 21:08:26 user devstack@n-api.service[61909]: [pid: 61909|app: 0|req: 352/1057] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:08:26 2023] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:27 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:08:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-9264c179-8107-4d6d-8dc1-e96f66e2edf6 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1494 microversion: 2.1 time: 0.239539 Apr 11 21:08:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 351/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:08:26 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1494 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=12 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:08:40 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b HTTP/1.1 Apr 11 21:08:40 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:08:40 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:08:40 user devstack@n-api.service[61907]: Connection: close Apr 11 21:08:40 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:08:40 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:08:40 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:08:40 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:08:40 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:08:40 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:08:40 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:08:40 user devstack@n-api.service[61907]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:08:40 user devstack@n-api.service[61907]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:08:40 user devstack@n-api.service[61907]: method: > Apr 11 21:08:40 user devstack@n-api.service[61907]: exception: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:08:40 user devstack@n-api.service[61907]: action_args: {'id': 'ac91ed34-8f95-477d-a951-efa13ccff67b'} Apr 11 21:08:40 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:08:40 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:08:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:08:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e2ec832b-34c8-4155-b713-8db0964f42a6 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 404 len: 111 microversion: 2.1 time: 0.114836 Apr 11 21:08:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 356/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:08:40 2023] GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:08:40 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=2 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:40 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:40 user devstack@n-api.service[61909]: DEBUG nova.api.openstack.wsgi [None req-899923c5-950a-4af8-8111-2804a42ac40f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1202217241", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1519294118", "security_groups": [{"name": "tempest-secgroup-smoke-2042118004"}], "block_device_mapping_v2": [{"uuid": "86fa1780-adb9-4e29-b424-0e7bfeee531d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa"}]}} {{(pid=61909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:08:40 user devstack@n-api.service[61909]: DEBUG nova.network.neutron [None req-899923c5-950a-4af8-8111-2804a42ac40f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] validate_networks() for [('173a3c12-0c1e-4a4c-9682-6e5d62f61daa', None, None, None, None, None)] {{(pid=61909) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:08:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] HTTP exception thrown: Instance 0a7a0115-1cce-4dab-8207-812e4836a257 could not be found. Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Request method failure captured: Apr 11 21:08:49 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257 HTTP/1.1 Apr 11 21:08:49 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:08:49 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:08:49 user devstack@n-api.service[61908]: Connection: close Apr 11 21:08:49 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:08:49 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:08:49 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:08:49 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:08:49 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcscd-l_YaMR5E3JA18RBQcN6o2VnQ89A-2NPrO1HXdJWtvO6PS4E-JXVwLJJTyOF70xm8O6E2r_AB71RKsumm1HgtipmehrRmob9QpLMKuB_5r8Kl6yHFfRBYLq_R447nNWaPPOalEAPqtlVYCt04Y2EzuILOpTliM4MXfQf9dyHFA Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Project-Id: be7eb572d88b49979f0c987e7c14e078 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Project-Name: tempest-VolumesActionsTest-938970583 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be7eb572d88b49979f0c987e7c14e078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be7eb572d88b49979f0c987e7c14e078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be7eb572d88b49979f0c987e7c14e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Tenant: tempest-VolumesActionsTest-938970583 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Tenant-Id: be7eb572d88b49979f0c987e7c14e078 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-VolumesActionsTest-938970583 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-User: tempest-VolumesActionsTest-938970583-project-member Apr 11 21:08:49 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:08:49 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:08:49 user devstack@n-api.service[61908]: X-User-Id: 1a7549924a014f40a6568d7d771b6957 Apr 11 21:08:49 user devstack@n-api.service[61908]: X-User-Name: tempest-VolumesActionsTest-938970583-project-member Apr 11 21:08:49 user devstack@n-api.service[61908]: method: > Apr 11 21:08:49 user devstack@n-api.service[61908]: exception: Instance 0a7a0115-1cce-4dab-8207-812e4836a257 could not be found. Apr 11 21:08:49 user devstack@n-api.service[61908]: action_args: {'id': '0a7a0115-1cce-4dab-8207-812e4836a257'} Apr 11 21:08:49 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a7a0115-1cce-4dab-8207-812e4836a257 could not be found. Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a7a0115-1cce-4dab-8207-812e4836a257 could not be found. Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a7a0115-1cce-4dab-8207-812e4836a257 could not be found. Apr 11 21:08:49 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:08:49 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Returning 404 to user: Instance 0a7a0115-1cce-4dab-8207-812e4836a257 could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:08:49 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8f0c5cfd-8d81-437f-b017-e80a9fd42166 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257" status: 404 len: 111 microversion: 2.1 time: 0.085728 Apr 11 21:08:49 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 352/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:08:49 2023] GET /compute/v2.1/servers/0a7a0115-1cce-4dab-8207-812e4836a257 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:08:51 user devstack@n-api.service[61909]: DEBUG dbcounter [-] [61909] Writing DB stats nova_api:SELECT=4 {{(pid=61909) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e5e01e94-6d0b-429e-9c32-d45f4513aec5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043962 Apr 11 21:09:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 357/1061] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:09:16 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9115153-339d-4f78-b654-8c13fd359cad"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331907 Apr 11 21:09:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 353/1062] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:09:17 2023] POST /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:25 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'services' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:09:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/a9115153-339d-4f78-b654-8c13fd359cad" status: 202 len: 0 microversion: 2.1 time: 0.169453 Apr 11 21:09:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 358/1063] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:09:25 2023] DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments/a9115153-339d-4f78-b654-8c13fd359cad => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-041e06a2-2e96-4010-b249-0c452c6de5d8 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048933 Apr 11 21:09:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 354/1064] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:09:25 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] HTTP exception thrown: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Request method failure captured: Apr 11 21:09:30 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a HTTP/1.1 Apr 11 21:09:30 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:09:30 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:09:30 user devstack@n-api.service[61907]: Connection: close Apr 11 21:09:30 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:09:30 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:09:30 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:09:30 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:09:30 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcqBFg2FhH1Dwvp08OlK-znDZSWdAuF6iIVekdbCHWeqwAG3Nu3flXrlxGNhN6Y05Wqm2a5sTcwPJePhhLqINkcyhq8rqGohqer-_z8wTurTG5Q_IIhOmPiywLKpkStD0E_2uVpLIQx9wt8b4PDbTezzu9IsSB018qZGnBZEdpW6EdA Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Project-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Tenant: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Tenant-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:09:30 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:09:30 user devstack@n-api.service[61907]: X-User: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:09:30 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:09:30 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:09:30 user devstack@n-api.service[61907]: X-User-Id: 8557484fdf27419384420c986b776a90 Apr 11 21:09:30 user devstack@n-api.service[61907]: X-User-Name: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:09:30 user devstack@n-api.service[61907]: method: > Apr 11 21:09:30 user devstack@n-api.service[61907]: exception: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61907]: action_args: {'id': 'b4313738-e01e-49d3-880b-5c74b75b740a'} Apr 11 21:09:30 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Returning 404 to user: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:09:30 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-69a0649e-4891-45e2-a24a-0c80984a0fde tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 404 len: 111 microversion: 2.1 time: 0.032700 Apr 11 21:09:30 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 359/1065] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:09:30 2023] DELETE /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] HTTP exception thrown: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Request method failure captured: Apr 11 21:09:30 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a HTTP/1.1 Apr 11 21:09:30 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:09:30 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:09:30 user devstack@n-api.service[61908]: Connection: close Apr 11 21:09:30 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:09:30 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:09:30 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:09:30 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:09:30 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcqBFg2FhH1Dwvp08OlK-znDZSWdAuF6iIVekdbCHWeqwAG3Nu3flXrlxGNhN6Y05Wqm2a5sTcwPJePhhLqINkcyhq8rqGohqer-_z8wTurTG5Q_IIhOmPiywLKpkStD0E_2uVpLIQx9wt8b4PDbTezzu9IsSB018qZGnBZEdpW6EdA Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Project-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Project-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Tenant: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Tenant-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:09:30 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:09:30 user devstack@n-api.service[61908]: X-User: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:09:30 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:09:30 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:09:30 user devstack@n-api.service[61908]: X-User-Id: 8557484fdf27419384420c986b776a90 Apr 11 21:09:30 user devstack@n-api.service[61908]: X-User-Name: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:09:30 user devstack@n-api.service[61908]: method: > Apr 11 21:09:30 user devstack@n-api.service[61908]: exception: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61908]: action_args: {'id': 'b4313738-e01e-49d3-880b-5c74b75b740a'} Apr 11 21:09:30 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. Apr 11 21:09:30 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Returning 404 to user: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:09:30 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1ed9cb89-7d86-42fd-b886-b4902659ca72 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a" status: 404 len: 111 microversion: 2.1 time: 0.033037 Apr 11 21:09:30 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 355/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:09:30 2023] GET /compute/v2.1/servers/b4313738-e01e-49d3-880b-5c74b75b740a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:09:30 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 204 len: 0 microversion: 2.1 time: 0.143557 Apr 11 21:09:30 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 360/1067] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:09:30 2023] DELETE /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:30 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:09:30 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-ed7b7008-e602-4a45-b9ff-9ac66b05ccff tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 200 len: 1500 microversion: 2.1 time: 0.246371 Apr 11 21:09:30 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 356/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:09:30 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 1500 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:09:31 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0171d4-fddd-424b-9b11-9f78723f3c1b", "name": "network-vif-unplugged", "status": "completed", "tag": "3a08d9a8-9b94-4131-b609-11988264e1a8"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:31 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:31 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Creating event network-vif-unplugged:3a08d9a8-9b94-4131-b609-11988264e1a8 for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b on user Apr 11 21:09:31 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044476 Apr 11 21:09:31 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 357/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:09:31 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-6de184cd-62e0-454c-adfe-b9ab11af1718 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Action: 'create', calling method: .version_select at 0x7f726833eb00>, body: {"keypair": {"name": "tempest-TestStampPattern-438473114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg=="}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:31 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-6de184cd-62e0-454c-adfe-b9ab11af1718 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting quotas for project 853a13c27fc0436ab974cfe37f565b75. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:09:31 user devstack@n-api.service[61907]: DEBUG nova.quota [None req-6de184cd-62e0-454c-adfe-b9ab11af1718 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting quotas for user 1d759f5d03a44e79b24dd72e2b83d4c1 and project 853a13c27fc0436ab974cfe37f565b75. Resources: {'key_pairs'} {{(pid=61907) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:09:31 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-6de184cd-62e0-454c-adfe-b9ab11af1718 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.309527 Apr 11 21:09:31 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 361/1070] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:09:30 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:09:32 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0171d4-fddd-424b-9b11-9f78723f3c1b", "name": "network-vif-deleted", "tag": "3a08d9a8-9b94-4131-b609-11988264e1a8"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:32 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] Creating event network-vif-deleted:3a08d9a8-9b94-4131-b609-11988264e1a8 for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b on user Apr 11 21:09:32 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028004 Apr 11 21:09:32 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 358/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:09:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:33 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0171d4-fddd-424b-9b11-9f78723f3c1b", "name": "network-vif-plugged", "status": "completed", "tag": "3a08d9a8-9b94-4131-b609-11988264e1a8"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:33 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Creating event network-vif-plugged:3a08d9a8-9b94-4131-b609-11988264e1a8 for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b on user Apr 11 21:09:33 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Apr 11 21:09:33 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 362/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1157518724", "imageRef": "5eb5099b-ba97-47ac-833b-8ebacdc3051a", "flavorRef": "42", "key_name": "tempest-TestStampPattern-438473114", "security_groups": [{"name": "tempest-secgroup-smoke-1609240851"}], "networks": [{"uuid": "5bf259c8-6ed5-419a-a20f-bc274f322278"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] validate_networks() for [('5bf259c8-6ed5-419a-a20f-bc274f322278', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting quotas for project 853a13c27fc0436ab974cfe37f565b75. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting quotas for user 1d759f5d03a44e79b24dd72e2b83d4c1 and project 853a13c27fc0436ab974cfe37f565b75. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:09:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eb5099b-ba97-47ac-833b-8ebacdc3051a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:09:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.704929 Apr 11 21:09:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 359/1073] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:09:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:09:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d887678b-47a6-4501-b5ee-0359daa5d2df tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d887678b-47a6-4501-b5ee-0359daa5d2df tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:34 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-d887678b-47a6-4501-b5ee-0359daa5d2df tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:09:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d887678b-47a6-4501-b5ee-0359daa5d2df tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41" status: 200 len: 1236 microversion: 2.1 time: 0.064857 Apr 11 21:09:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 363/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:09:34 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:09:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Creating event network-changed:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:09:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028324 Apr 11 21:09:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 360/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:39 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "name": "network-vif-plugged", "status": "completed", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:39 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Creating event network-vif-plugged:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:09:39 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040000 Apr 11 21:09:39 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 364/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "name": "network-vif-plugged", "status": "completed", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Creating event network-vif-plugged:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:09:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034315 Apr 11 21:09:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 361/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:09:41 user devstack@n-api.service[61907]: request: DELETE /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b HTTP/1.1 Apr 11 21:09:41 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:09:41 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:09:41 user devstack@n-api.service[61907]: Connection: close Apr 11 21:09:41 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:09:41 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:09:41 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:09:41 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:09:41 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:09:41 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:09:41 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:09:41 user devstack@n-api.service[61907]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:09:41 user devstack@n-api.service[61907]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:09:41 user devstack@n-api.service[61907]: method: > Apr 11 21:09:41 user devstack@n-api.service[61907]: exception: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61907]: action_args: {'id': 'ac91ed34-8f95-477d-a951-efa13ccff67b'} Apr 11 21:09:41 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:09:41 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-37addc28-8491-437b-b3a5-9985bc639924 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 404 len: 111 microversion: 2.1 time: 0.035343 Apr 11 21:09:41 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 365/1078] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:09:41 2023] DELETE /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:09:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HTTP exception thrown: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Request method failure captured: Apr 11 21:09:41 user devstack@n-api.service[61908]: request: GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b HTTP/1.1 Apr 11 21:09:41 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:09:41 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:09:41 user devstack@n-api.service[61908]: Connection: close Apr 11 21:09:41 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:09:41 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:09:41 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:09:41 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:09:41 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcm3TOIxclJhi5tcTinyzi6N8ykCFZXwOf1kAIGsYW6Wj24OJ0qKfmbOZrvaZzSl293TscT8NehgtW--_BkPbbHqqyH8CsQdGY0AqpjmKHhjSG44tgKkd7QLOsW82BerIu2wmS1lxfAwJ8AzOBZLpUhkM2jW53GJ3gl1uC1AC4RGK5A Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Project-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c36c3a15f2a413e81544f65c4f6ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Tenant: tempest-TestVolumeBootPattern-221737316 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Tenant-Id: 2c36c3a15f2a413e81544f65c4f6ede4 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestVolumeBootPattern-221737316 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-User: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:09:41 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:09:41 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:09:41 user devstack@n-api.service[61908]: X-User-Id: 3e34c9542bd64328a3c8d5cdb7421917 Apr 11 21:09:41 user devstack@n-api.service[61908]: X-User-Name: tempest-TestVolumeBootPattern-221737316-project-member Apr 11 21:09:41 user devstack@n-api.service[61908]: method: > Apr 11 21:09:41 user devstack@n-api.service[61908]: exception: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61908]: action_args: {'id': 'ac91ed34-8f95-477d-a951-efa13ccff67b'} Apr 11 21:09:41 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. Apr 11 21:09:41 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:09:41 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Returning 404 to user: Instance ac91ed34-8f95-477d-a951-efa13ccff67b could not be found. {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:09:41 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-a244c1cc-2571-47ea-b23b-c99c9e7a30be tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b" status: 404 len: 111 microversion: 2.1 time: 0.029082 Apr 11 21:09:41 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 362/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:09:41 2023] GET /compute/v2.1/servers/ac91ed34-8f95-477d-a951-efa13ccff67b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:09:42 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-1bc3da69-ee54-44b3-ae90-e7ddc190b846 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Calling method '.version_select at 0x7f726856aef0>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:09:42 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-1bc3da69-ee54-44b3-ae90-e7ddc190b846 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1519294118" status: 202 len: 0 microversion: 2.1 time: 0.021050 Apr 11 21:09:42 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 366/1080] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 11 21:09:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1519294118 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:15 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:15 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-35c3ba56-5fc8-4fa1-af18-3604b6986730 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049675 Apr 11 21:10:15 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 363/1081] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:10:15 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=6 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] HTTP exception thrown: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. Apr 11 21:10:21 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Request method failure captured: Apr 11 21:10:21 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b HTTP/1.1 Apr 11 21:10:21 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:10:21 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:10:21 user devstack@n-api.service[61907]: Connection: close Apr 11 21:10:21 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:10:21 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:10:21 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:10:21 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:10:21 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcqBFg2FhH1Dwvp08OlK-znDZSWdAuF6iIVekdbCHWeqwAG3Nu3flXrlxGNhN6Y05Wqm2a5sTcwPJePhhLqINkcyhq8rqGohqer-_z8wTurTG5Q_IIhOmPiywLKpkStD0E_2uVpLIQx9wt8b4PDbTezzu9IsSB018qZGnBZEdpW6EdA Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Project-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Project-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf42a499ff3c43afaea1b716c0e801ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Tenant: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Tenant-Id: cf42a499ff3c43afaea1b716c0e801ac Apr 11 21:10:21 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1791140415 Apr 11 21:10:21 user devstack@n-api.service[61907]: X-User: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:10:21 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:10:21 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:10:21 user devstack@n-api.service[61907]: X-User-Id: 8557484fdf27419384420c986b776a90 Apr 11 21:10:21 user devstack@n-api.service[61907]: X-User-Name: tempest-ServersNegativeTestJSON-1791140415-project-member Apr 11 21:10:21 user devstack@n-api.service[61907]: method: > Apr 11 21:10:21 user devstack@n-api.service[61907]: exception: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. Apr 11 21:10:21 user devstack@n-api.service[61907]: action_args: {'id': '5a0171d4-fddd-424b-9b11-9f78723f3c1b'} Apr 11 21:10:21 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. Apr 11 21:10:21 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:10:21 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Returning 404 to user: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:10:21 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e01bee0d-c2eb-4ff0-9f37-d842ef55caed tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b" status: 404 len: 111 microversion: 2.1 time: 0.044780 Apr 11 21:10:21 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 367/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:10:20 2023] GET /compute/v2.1/servers/5a0171d4-fddd-424b-9b11-9f78723f3c1b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:10:24 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:10:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:24 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Creating event network-changed:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:10:24 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033156 Apr 11 21:10:24 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 364/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:10:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:10:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-8102873c-cffb-425a-9fd9-c71af15626af tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41" status: 200 len: 1539 microversion: 2.1 time: 0.220749 Apr 11 21:10:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 368/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:10:24 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:10:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb" status: 204 len: 0 microversion: 2.1 time: 0.114231 Apr 11 21:10:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 365/1085] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:10:26 2023] DELETE /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:26 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d8e96524894243b3226f4df3c42376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6233baae51b44238a630a75ccea0bdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:10:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-603170d6-eb48-4320-8cfe-b06f10714c44 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb" status: 200 len: 1575 microversion: 2.1 time: 0.209212 Apr 11 21:10:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 369/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:10:26 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "name": "network-vif-unplugged", "status": "completed", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Creating event network-vif-unplugged:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:10:26 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029719 Apr 11 21:10:26 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 366/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:10:27 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "name": "network-vif-deleted", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:10:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] Creating event network-vif-deleted:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:10:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031106 Apr 11 21:10:27 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 370/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:10:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:10:28 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5969528-6603-4329-8cc3-8d97e162b8cb", "name": "network-vif-plugged", "status": "completed", "tag": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:10:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:10:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:10:28 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:10:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Creating event network-vif-plugged:ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance b5969528-6603-4329-8cc3-8d97e162b8cb on user Apr 11 21:10:28 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 Apr 11 21:10:28 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 367/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:10:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=16 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] HTTP exception thrown: Instance b5969528-6603-4329-8cc3-8d97e162b8cb could not be found. Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Request method failure captured: Apr 11 21:11:16 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb HTTP/1.1 Apr 11 21:11:16 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:11:16 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:11:16 user devstack@n-api.service[61907]: Connection: close Apr 11 21:11:16 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:11:16 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:11:16 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:11:16 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:11:16 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNctL36CFzxi5E73oH7EgJujC96Oix7wHUKqItesBEEkj9sIWNlPThf5tOtd_NJURNASuYXi28mIq27o8tIBIVDZNiAn60HoAfI3HLZcZ37jKp5p-41iuPJ0IDPqBheCm82Wg9GSGjH1UsdhWIrBuxZbO9U4jjNoWgVdYOfsjc-Pmal4 Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Project-Id: 6233baae51b44238a630a75ccea0bdbf Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Project-Name: tempest-SnapshotDataIntegrityTests-906456256 Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6233baae51b44238a630a75ccea0bdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6233baae51b44238a630a75ccea0bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6233baae51b44238a630a75ccea0bdbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Tenant: tempest-SnapshotDataIntegrityTests-906456256 Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Tenant-Id: 6233baae51b44238a630a75ccea0bdbf Apr 11 21:11:16 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-906456256 Apr 11 21:11:16 user devstack@n-api.service[61907]: X-User: tempest-SnapshotDataIntegrityTests-906456256-project-member Apr 11 21:11:16 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:11:16 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:11:16 user devstack@n-api.service[61907]: X-User-Id: 03d8e96524894243b3226f4df3c42376 Apr 11 21:11:16 user devstack@n-api.service[61907]: X-User-Name: tempest-SnapshotDataIntegrityTests-906456256-project-member Apr 11 21:11:16 user devstack@n-api.service[61907]: method: > Apr 11 21:11:16 user devstack@n-api.service[61907]: exception: Instance b5969528-6603-4329-8cc3-8d97e162b8cb could not be found. Apr 11 21:11:16 user devstack@n-api.service[61907]: action_args: {'id': 'b5969528-6603-4329-8cc3-8d97e162b8cb'} Apr 11 21:11:16 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5969528-6603-4329-8cc3-8d97e162b8cb could not be found. Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5969528-6603-4329-8cc3-8d97e162b8cb could not be found. Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5969528-6603-4329-8cc3-8d97e162b8cb could not be found. Apr 11 21:11:16 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:11:16 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Returning 404 to user: Instance b5969528-6603-4329-8cc3-8d97e162b8cb could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:11:16 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-b7e34a4a-a803-444c-a9d4-7b65265f063e tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb" status: 404 len: 111 microversion: 2.1 time: 0.032190 Apr 11 21:11:16 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 371/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:11:16 2023] GET /compute/v2.1/servers/b5969528-6603-4329-8cc3-8d97e162b8cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:11:16 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-1a5cd419-935c-44e7-8974-1069c1a4569f tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Calling method '.version_select at 0x7f72683cbe20>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:11:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:11:17 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:11:17 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-1a5cd419-935c-44e7-8974-1069c1a4569f tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1721986425" status: 202 len: 0 microversion: 2.1 time: 0.029972 Apr 11 21:11:17 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 368/1091] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 11 21:11:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1721986425 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:11:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-989c746a-5c03-4757-9558-cf04a3241b55 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41" status: 200 len: 1539 microversion: 2.1 time: 0.341540 Apr 11 21:11:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 372/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:11:25 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 => generated 1539 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:11:27 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:11:27 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:11:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Creating event network-changed:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:11:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053253 Apr 11 21:11:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 369/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f3491d9-cd43-418a-9e3a-795034a81016"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:27 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278960 Apr 11 21:11:27 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 373/1094] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:11:27 2023] POST /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:34 user devstack@n-api.service[61908]: DEBUG nova.objects.instance [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'services' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=61908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:11:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments/2f3491d9-cd43-418a-9e3a-795034a81016" status: 202 len: 0 microversion: 2.1 time: 0.181543 Apr 11 21:11:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 370/1095] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:11:34 2023] DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments/2f3491d9-cd43-418a-9e3a-795034a81016 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:11:35 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:11:35 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-78409b93-561e-451b-9288-15341e49db4f tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046661 Apr 11 21:11:35 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 374/1096] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:11:35 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=4 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-4e2353a8-d8a2-4221-9ec9-f1391e2023ae tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051163 Apr 11 21:12:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 371/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:12:25 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-769677008"}} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:27 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/action" status: 202 len: 0 microversion: 2.1 time: 0.902326 Apr 11 21:12:27 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 375/1098] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:12:26 2023] POST /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/action => generated 0 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-667122662", "imageRef": "87ff6c41-d0d1-4d7a-974c-50776e582d4b", "flavorRef": "42", "key_name": "tempest-TestStampPattern-438473114", "security_groups": [{"name": "tempest-secgroup-smoke-1609240851"}], "networks": [{"uuid": "5bf259c8-6ed5-419a-a20f-bc274f322278"}]}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] validate_networks() for [('5bf259c8-6ed5-419a-a20f-bc274f322278', None, None, None, None, None)] {{(pid=61908) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image limits 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image pref 0:0:0 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting quotas for project 853a13c27fc0436ab974cfe37f565b75. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.quota [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting quotas for user 1d759f5d03a44e79b24dd72e2b83d4c1 and project 853a13c27fc0436ab974cfe37f565b75. Resources: {'cores', 'ram', 'instances'} {{(pid=61908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Going to run 1 instances... {{(pid=61908) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:12:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ff6c41-d0d1-4d7a-974c-50776e582d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:12:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.647310 Apr 11 21:12:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 372/1099] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:12:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:12:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-0272f675-2ab4-41ee-a08c-e4be109514ec tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:12:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-0272f675-2ab4-41ee-a08c-e4be109514ec tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:12:34 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-0272f675-2ab4-41ee-a08c-e4be109514ec tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:12:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-0272f675-2ab4-41ee-a08c-e4be109514ec tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a" status: 200 len: 1235 microversion: 2.1 time: 0.068168 Apr 11 21:12:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 376/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:12:34 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:12:37 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:12:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:37 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Creating event network-changed:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:12:37 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037326 Apr 11 21:12:37 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 373/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:12:40 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "name": "network-vif-plugged", "status": "completed", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:12:40 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:12:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:40 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Creating event network-vif-plugged:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:12:40 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030638 Apr 11 21:12:40 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 377/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:12:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:12:42 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "name": "network-vif-plugged", "status": "completed", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:12:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:12:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:12:42 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:12:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Creating event network-vif-plugged:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:12:42 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Apr 11 21:12:42 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 374/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell0:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:13:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:13:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:13:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-300d78ce-109c-4a44-9b4f-345e04333831 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a" status: 200 len: 1537 microversion: 2.1 time: 0.171066 Apr 11 21:13:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 378/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:13:24 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=2 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell0:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=12 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:25 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:14:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8fc2501e-e3c7-475c-8372-445694bb4133 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a" status: 200 len: 1537 microversion: 2.1 time: 0.172793 Apr 11 21:14:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 375/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:14:25 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:14:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=2 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:14:26 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:14:26 user devstack@n-api.service[61907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 21:14:26 user devstack@n-api.service[61907]: Tue Apr 11 21:14:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 21:14:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:14:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Creating event network-changed:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:14:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099211 Apr 11 21:14:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 379/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "528bd232-04cf-4816-86aa-5f3f00c2e4aa"}} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:26 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301526 Apr 11 21:14:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 376/1107] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:14:26 2023] POST /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:34 user devstack@n-api.service[61907]: DEBUG nova.objects.instance [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'services' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=61907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:14:34 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments/528bd232-04cf-4816-86aa-5f3f00c2e4aa" status: 202 len: 0 microversion: 2.1 time: 0.158560 Apr 11 21:14:34 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 380/1108] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:14:34 2023] DELETE /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments/528bd232-04cf-4816-86aa-5f3f00c2e4aa => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:14:34 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:14:34 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-24d6689d-3b98-4d1e-a308-69fd9dac67b8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047743 Apr 11 21:14:34 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 377/1109] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:14:34 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=4 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:24 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:24 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-9775f8dd-2ad9-471b-a491-e212cc6bf3f8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053372 Apr 11 21:15:24 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 381/1110] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:15:24 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:15:25 user devstack@n-api.service[61908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 21:15:25 user devstack@n-api.service[61908]: Tue Apr 11 21:15:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a (ip 10.0.0.210) !!! Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=6 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Creating event network-changed:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:15:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028355 Apr 11 21:15:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 382/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Going to try to terminate instance {{(pid=61908) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:15:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a" status: 204 len: 0 microversion: 2.1 time: 0.157679 Apr 11 21:15:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 378/1112] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:15:25 2023] DELETE /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:25 user devstack@n-api.service[61907]: DEBUG nova.policy [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61907) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:15:25 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-f6e94663-706e-44a3-992f-3d52a1154bfc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a" status: 200 len: 1662 microversion: 2.1 time: 0.171808 Apr 11 21:15:25 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 383/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:15:25 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a => generated 1662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "name": "network-vif-unplugged", "status": "completed", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:25 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Creating event network-vif-unplugged:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:15:25 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118945 Apr 11 21:15:25 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 379/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:15:26 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "name": "network-vif-deleted", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:15:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:26 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] Creating event network-vif-deleted:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:15:26 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089955 Apr 11 21:15:26 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 384/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:15:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:15:27 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7918f9a-aff3-471c-b53d-a076481acb2a", "name": "network-vif-plugged", "status": "completed", "tag": "2111d0ac-22e9-40dd-b069-26b5aeed33f5"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:15:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:15:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:15:27 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:15:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Creating event network-vif-plugged:2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance c7918f9a-aff3-471c-b53d-a076481acb2a on user Apr 11 21:15:27 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Apr 11 21:15:27 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 380/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:15:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=8 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=16 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:16:15 user devstack@n-api.service[61907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 21:16:15 user devstack@n-api.service[61907]: Tue Apr 11 21:16:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a (ip 10.0.0.210) !!! Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:15 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] HTTP exception thrown: Instance c7918f9a-aff3-471c-b53d-a076481acb2a could not be found. Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Request method failure captured: Apr 11 21:16:15 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a HTTP/1.1 Apr 11 21:16:15 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:16:15 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:16:15 user devstack@n-api.service[61907]: Connection: close Apr 11 21:16:15 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:16:15 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:16:15 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:16:15 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:16:15 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcyE4FdT8xhnw_AChJ15DIcp3FszdjBlr2R34iuUFoIew-3ZfQHt-OW2fNHxmUeFncRBhb6TvtQe7OAq-53VSKwyCnInCqZuMv53NcdQN45kMslOVBLTYMbfT2HzNVxzWLrlHvc-Yl8yiYWk3lChrGY0v652VrGENlzxBm5y5HvIMcE Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Project-Id: 853a13c27fc0436ab974cfe37f565b75 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestStampPattern-534186208 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Tenant: tempest-TestStampPattern-534186208 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Tenant-Id: 853a13c27fc0436ab974cfe37f565b75 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestStampPattern-534186208 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-User: tempest-TestStampPattern-534186208-project-member Apr 11 21:16:15 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:16:15 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:16:15 user devstack@n-api.service[61907]: X-User-Id: 1d759f5d03a44e79b24dd72e2b83d4c1 Apr 11 21:16:15 user devstack@n-api.service[61907]: X-User-Name: tempest-TestStampPattern-534186208-project-member Apr 11 21:16:15 user devstack@n-api.service[61907]: method: > Apr 11 21:16:15 user devstack@n-api.service[61907]: exception: Instance c7918f9a-aff3-471c-b53d-a076481acb2a could not be found. Apr 11 21:16:15 user devstack@n-api.service[61907]: action_args: {'id': 'c7918f9a-aff3-471c-b53d-a076481acb2a'} Apr 11 21:16:15 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7918f9a-aff3-471c-b53d-a076481acb2a could not be found. Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7918f9a-aff3-471c-b53d-a076481acb2a could not be found. Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7918f9a-aff3-471c-b53d-a076481acb2a could not be found. Apr 11 21:16:15 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:16:15 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Returning 404 to user: Instance c7918f9a-aff3-471c-b53d-a076481acb2a could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:16:15 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-793b2c1d-6508-4e62-b43d-6cac86ea38ab tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a" status: 404 len: 111 microversion: 2.1 time: 0.039200 Apr 11 21:16:15 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 385/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:16:15 2023] GET /compute/v2.1/servers/c7918f9a-aff3-471c-b53d-a076481acb2a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.wsgi [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] HTTP exception thrown: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 is not attached to volume 2f3491d9-cd43-418a-9e3a-795034a81016 Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Request method failure captured: Apr 11 21:16:18 user devstack@n-api.service[61908]: request: DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments/2f3491d9-cd43-418a-9e3a-795034a81016 HTTP/1.1 Apr 11 21:16:18 user devstack@n-api.service[61908]: Accept: application/json Apr 11 21:16:18 user devstack@n-api.service[61908]: Accept-Encoding: identity Apr 11 21:16:18 user devstack@n-api.service[61908]: Connection: close Apr 11 21:16:18 user devstack@n-api.service[61908]: Content-Length: 0 Apr 11 21:16:18 user devstack@n-api.service[61908]: Content-Type: application/json Apr 11 21:16:18 user devstack@n-api.service[61908]: Host: 10.0.0.210 Apr 11 21:16:18 user devstack@n-api.service[61908]: Openstack-System-Scope: None Apr 11 21:16:18 user devstack@n-api.service[61908]: User-Agent: python-urllib3/1.26.15 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Auth-Token: gAAAAABkNcyE4FdT8xhnw_AChJ15DIcp3FszdjBlr2R34iuUFoIew-3ZfQHt-OW2fNHxmUeFncRBhb6TvtQe7OAq-53VSKwyCnInCqZuMv53NcdQN45kMslOVBLTYMbfT2HzNVxzWLrlHvc-Yl8yiYWk3lChrGY0v652VrGENlzxBm5y5HvIMcE Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Domain-Id: None Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Domain-Name: None Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Identity-Status: Confirmed Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Is-Admin-Project: True Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Project-Domain-Id: default Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Project-Domain-Name: Default Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Project-Id: 853a13c27fc0436ab974cfe37f565b75 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Project-Name: tempest-TestStampPattern-534186208 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Role: member,reader Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Roles: member,reader Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Tenant: tempest-TestStampPattern-534186208 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Tenant-Id: 853a13c27fc0436ab974cfe37f565b75 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-Tenant-Name: tempest-TestStampPattern-534186208 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-User: tempest-TestStampPattern-534186208-project-member Apr 11 21:16:18 user devstack@n-api.service[61908]: X-User-Domain-Id: default Apr 11 21:16:18 user devstack@n-api.service[61908]: X-User-Domain-Name: Default Apr 11 21:16:18 user devstack@n-api.service[61908]: X-User-Id: 1d759f5d03a44e79b24dd72e2b83d4c1 Apr 11 21:16:18 user devstack@n-api.service[61908]: X-User-Name: tempest-TestStampPattern-534186208-project-member Apr 11 21:16:18 user devstack@n-api.service[61908]: method: > Apr 11 21:16:18 user devstack@n-api.service[61908]: exception: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 is not attached to volume 2f3491d9-cd43-418a-9e3a-795034a81016 Apr 11 21:16:18 user devstack@n-api.service[61908]: action_args: {'server_id': '0e95600e-a2ef-41da-a997-93b6536feb41', 'id': '2f3491d9-cd43-418a-9e3a-795034a81016'} Apr 11 21:16:18 user devstack@n-api.service[61908]: {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2f3491d9-cd43-418a-9e3a-795034a81016. Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 is not attached to volume 2f3491d9-cd43-418a-9e3a-795034a81016 Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 is not attached to volume 2f3491d9-cd43-418a-9e3a-795034a81016 Apr 11 21:16:18 user devstack@n-api.service[61908]: ERROR nova.api.openstack.wsgi Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Returning 404 to user: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 is not attached to volume 2f3491d9-cd43-418a-9e3a-795034a81016 {{(pid=61908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:16:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-beeab629-e5c9-4ae0-97f4-0b5fe1b3af97 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments/2f3491d9-cd43-418a-9e3a-795034a81016" status: 404 len: 154 microversion: 2.1 time: 0.101627 Apr 11 21:16:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 381/1118] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:16:18 2023] DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41/os-volume_attachments/2f3491d9-cd43-418a-9e3a-795034a81016 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:18 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Creating event network-changed:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:16:18 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031210 Apr 11 21:16:18 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 382/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:16:18 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Going to try to terminate instance {{(pid=61907) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:16:19 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41" status: 204 len: 0 microversion: 2.1 time: 0.111715 Apr 11 21:16:19 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 386/1120] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:16:18 2023] DELETE /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG nova.compute.api [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61908) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:19 user devstack@n-api.service[61908]: DEBUG nova.policy [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61908) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:16:19 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f1a22a2b-a0c7-46bc-9e9e-4698dc1cb425 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41" status: 200 len: 1664 microversion: 2.1 time: 0.201902 Apr 11 21:16:19 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 383/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:16:19 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 21:16:20 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "name": "network-vif-deleted", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:16:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:20 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.compute.server_external_events [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] Creating event network-vif-deleted:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:16:20 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 Apr 11 21:16:20 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 387/1122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:16:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:16:21 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "name": "network-vif-unplugged", "status": "completed", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}, {"server_uuid": "0e95600e-a2ef-41da-a997-93b6536feb41", "name": "network-vif-plugged", "status": "completed", "tag": "486ad182-7f24-417b-9114-3cf40e02c9be"}]} {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:16:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:16:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:16:21 user devstack@n-api.service[61908]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61908) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:16:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Creating event network-vif-unplugged:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:16:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.compute.server_external_events [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Creating event network-vif-plugged:486ad182-7f24-417b-9114-3cf40e02c9be for instance 0e95600e-a2ef-41da-a997-93b6536feb41 on user Apr 11 21:16:21 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033817 Apr 11 21:16:21 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 384/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:16:21 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG dbcounter [-] [61907] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61907) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '>' {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG nova.compute.api [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Fetching instance by UUID {{(pid=61907) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "5e02bfc2-5dac-4137-870a-5f9b73964451" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG oslo_concurrency.lockutils [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "5e02bfc2-5dac-4137-870a-5f9b73964451" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61907) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:17:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.wsgi [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] HTTP exception thrown: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 could not be found. Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Request method failure captured: Apr 11 21:17:09 user devstack@n-api.service[61907]: request: GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 HTTP/1.1 Apr 11 21:17:09 user devstack@n-api.service[61907]: Accept: application/json Apr 11 21:17:09 user devstack@n-api.service[61907]: Accept-Encoding: identity Apr 11 21:17:09 user devstack@n-api.service[61907]: Connection: close Apr 11 21:17:09 user devstack@n-api.service[61907]: Content-Length: 0 Apr 11 21:17:09 user devstack@n-api.service[61907]: Content-Type: application/json Apr 11 21:17:09 user devstack@n-api.service[61907]: Host: 10.0.0.210 Apr 11 21:17:09 user devstack@n-api.service[61907]: Openstack-System-Scope: None Apr 11 21:17:09 user devstack@n-api.service[61907]: User-Agent: python-urllib3/1.26.15 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Auth-Token: gAAAAABkNcyE4FdT8xhnw_AChJ15DIcp3FszdjBlr2R34iuUFoIew-3ZfQHt-OW2fNHxmUeFncRBhb6TvtQe7OAq-53VSKwyCnInCqZuMv53NcdQN45kMslOVBLTYMbfT2HzNVxzWLrlHvc-Yl8yiYWk3lChrGY0v652VrGENlzxBm5y5HvIMcE Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Domain-Id: None Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Domain-Name: None Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Identity-Status: Confirmed Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Is-Admin-Project: True Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Project-Domain-Id: default Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Project-Domain-Name: Default Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Project-Id: 853a13c27fc0436ab974cfe37f565b75 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Project-Name: tempest-TestStampPattern-534186208 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Role: member,reader Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Roles: member,reader Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/853a13c27fc0436ab974cfe37f565b75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Tenant: tempest-TestStampPattern-534186208 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Tenant-Id: 853a13c27fc0436ab974cfe37f565b75 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-Tenant-Name: tempest-TestStampPattern-534186208 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-User: tempest-TestStampPattern-534186208-project-member Apr 11 21:17:09 user devstack@n-api.service[61907]: X-User-Domain-Id: default Apr 11 21:17:09 user devstack@n-api.service[61907]: X-User-Domain-Name: Default Apr 11 21:17:09 user devstack@n-api.service[61907]: X-User-Id: 1d759f5d03a44e79b24dd72e2b83d4c1 Apr 11 21:17:09 user devstack@n-api.service[61907]: X-User-Name: tempest-TestStampPattern-534186208-project-member Apr 11 21:17:09 user devstack@n-api.service[61907]: method: > Apr 11 21:17:09 user devstack@n-api.service[61907]: exception: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 could not be found. Apr 11 21:17:09 user devstack@n-api.service[61907]: action_args: {'id': '0e95600e-a2ef-41da-a997-93b6536feb41'} Apr 11 21:17:09 user devstack@n-api.service[61907]: {{(pid=61907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 could not be found. Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 could not be found. Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 could not be found. Apr 11 21:17:09 user devstack@n-api.service[61907]: ERROR nova.api.openstack.wsgi Apr 11 21:17:09 user devstack@n-api.service[61907]: DEBUG nova.api.openstack.wsgi [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Returning 404 to user: Instance 0e95600e-a2ef-41da-a997-93b6536feb41 could not be found. {{(pid=61907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:17:09 user devstack@n-api.service[61907]: INFO nova.api.openstack.requestlog [None req-713a2e4e-e177-4a47-be09-5bff8acbc71c tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41" status: 404 len: 111 microversion: 2.1 time: 0.036823 Apr 11 21:17:09 user devstack@n-api.service[61907]: [pid: 61907|app: 0|req: 388/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:17:09 2023] GET /compute/v2.1/servers/0e95600e-a2ef-41da-a997-93b6536feb41 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:17:11 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_api:SELECT=8 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:17:11 user devstack@n-api.service[61908]: DEBUG dbcounter [-] [61908] Writing DB stats nova_cell1:SELECT=16 {{(pid=61908) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:17:11 user devstack@n-api.service[61908]: DEBUG nova.api.openstack.wsgi [None req-f2778d84-a171-4ea1-a4b9-cfcb96a66424 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Calling method '.version_select at 0x7f72684a1360>' {{(pid=61908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:17:11 user devstack@n-api.service[61908]: INFO nova.api.openstack.requestlog [None req-f2778d84-a171-4ea1-a4b9-cfcb96a66424 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-438473114" status: 202 len: 0 microversion: 2.1 time: 0.044867 Apr 11 21:17:11 user devstack@n-api.service[61908]: [pid: 61908|app: 0|req: 385/1125] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:17:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-438473114 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)